-- Logs begin at Mon 2022-02-07 03:35:46 UTC, end at Mon 2022-02-07 05:06:54 UTC. -- Feb 07 04:06:34.737900 dv-cinder-799631-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 07 04:06:34.747460 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 7 04:06:34 2022] *** Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: nodename: dv-cinder-799631-7-iscsi Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: machine: x86_64 Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: clock source: unix Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: pcre jit disabled Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: detected number of CPU cores: 4 Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: current working directory: / Feb 07 04:06:34.749465 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: detected binary path: /usr/bin/uwsgi-core Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: your processes number limit is 47680 Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: your memory page size is 4096 bytes Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: detected max file descriptor number: 2048 Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: lock engine: pthread robust mutexes Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: thunder lock: enabled Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 07 04:06:34.750148 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 07 04:06:34.795193 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: Python main interpreter initialized at 0x560e1d6809c0 Feb 07 04:06:34.795193 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: python threads support enabled Feb 07 04:06:34.795193 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: your server socket listen backlog is limited to 100 connections Feb 07 04:06:34.795193 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: your mercy for graceful operations on workers is 90 seconds Feb 07 04:06:34.795531 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: mapped 403077 bytes (393 KB) for 2 cores Feb 07 04:06:34.795612 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: *** Operational MODE: preforking *** Feb 07 04:06:34.795836 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: *** uWSGI is running in multiple interpreter mode *** Feb 07 04:06:34.795836 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: spawned uWSGI master process (pid: 102029) Feb 07 04:06:34.796011 dv-cinder-799631-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 07 04:06:34.797408 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: spawned uWSGI worker 1 (pid: 102030, cores: 1) Feb 07 04:06:34.797408 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: spawned uWSGI worker 2 (pid: 102031, cores: 1) Feb 07 04:06:34.797408 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 07 04:06:36.576924 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:06:36.576924 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: from cryptography.utils import int_from_bytes Feb 07 04:06:36.577593 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:06:36.577593 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: from cryptography.utils import int_from_bytes Feb 07 04:06:36.578033 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:06:36.578033 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: from cryptography.utils import int_from_bytes Feb 07 04:06:36.578146 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:06:36.578146 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: from cryptography.utils import int_from_bytes Feb 07 04:06:39.137243 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 04:06:39.137753 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 04:06:39.137976 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 04:06:39.138334 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 04:06:39.138453 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 04:06:39.138822 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 04:06:39.138913 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 04:06:39.139000 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.139206 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 04:06:39.139293 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.139573 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 04:06:39.139668 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.139835 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 04:06:39.139929 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.140226 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.140314 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.140537 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.140639 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.140858 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.140949 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.141176 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.141260 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.141514 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.141611 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.141805 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.141895 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.142124 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.142217 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.142446 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799631-7-iscsi {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.142532 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.142765 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.142858 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143040 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143136 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143371 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143460 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143689 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143783 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799631-7-iscsi {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.143996 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.144122 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.144340 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.144428 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.144647 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.144732 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.144970 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.145146 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.145289 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.145594 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.145736 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.145902 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.146023 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.146215 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.146413 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.146553 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.146763 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.146868 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.147077 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.147172 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.147394 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.147518 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.147735 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.147836 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.148077 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.148164 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.148395 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.148525 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.148722 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.148824 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799631-7-iscsi {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.149038 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.149128 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.149368 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.149533 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.149688 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.149772 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.150089 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799631-7-iscsi {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.150186 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.150399 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.150483 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.150711 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.150801 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151030 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151135 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151358 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151441 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151667 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151758 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.151996 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.152100 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.152351 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.152437 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.152670 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.152756 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.152989 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.153073 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.153291 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.153376 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.153599 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.153691 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.153908 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154006 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154229 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154332 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154534 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154626 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154838 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.154923 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.155089 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.155189 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.155400 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.155484 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.155720 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.155805 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156038 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156163 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156323 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156408 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156621 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156706 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.156877 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.157513 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.157720 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.157820 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158044 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158144 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158319 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158416 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158576 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158674 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.158901 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159006 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159227 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159327 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159542 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159631 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159853 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.159957 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.160185 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.160288 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.160496 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.160849 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.161078 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.161176 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.161395 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.161487 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.161709 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.161808 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162019 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162123 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162342 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162442 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162661 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162753 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.162978 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.163065 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.163291 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.163377 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.163613 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.163697 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.163936 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.164022 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.164274 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.164377 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.164596 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.164693 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.164914 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165008 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165224 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165319 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165534 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165630 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165845 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.165939 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.166164 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.166258 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.166478 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.166572 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.166793 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.166888 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167043 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167207 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167349 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167541 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167663 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167885 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.167970 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.168221 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.168307 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.168479 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.168602 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.168789 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.168912 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.169104 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.169199 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.169427 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.169524 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.169745 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.169832 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170059 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170143 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170374 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170460 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170680 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170764 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.170991 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.171082 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.171303 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.171386 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.171609 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.171692 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.171920 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.172012 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.172258 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.172354 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.172570 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.172687 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.173458 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.173556 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.173773 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.173858 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.174082 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.174174 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.174398 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.174503 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.174719 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.174813 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175031 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175116 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175343 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175436 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175656 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175740 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.175962 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.176070 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.176294 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.176395 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.176614 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.176711 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.176925 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177008 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177232 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177327 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177555 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177640 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177856 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.177940 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.178166 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.178258 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.178480 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.178572 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.178788 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.178872 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.179096 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.179181 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.179402 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.179486 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.179705 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.179790 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180011 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180152 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180343 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180427 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180646 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180745 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.180953 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181037 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181255 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181346 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181562 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181645 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181875 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.181966 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.182183 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.182272 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.182492 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.182590 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.182797 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.182884 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.183117 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.183200 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.183445 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.183538 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.183759 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.183850 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.184096 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.184184 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.184431 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.184570 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.184739 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:06:39.184836 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.185068 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.185158 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.185391 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.185488 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.185706 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.185790 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186025 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186116 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186353 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186439 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186668 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186762 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.186983 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.187074 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.187295 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.187386 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.187621 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.187712 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.187944 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.188034 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.188297 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.188388 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.188619 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.188704 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.188940 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189036 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189263 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189356 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189577 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189671 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189899 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.189983 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.190223 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.190315 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.190543 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.190627 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.190857 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.190940 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.191175 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.191266 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.191503 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.191587 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.191830 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.191926 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.192179 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.192267 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.192500 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.192585 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.192814 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.192913 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.193130 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.193223 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.193443 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.193534 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.193767 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.193863 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.194110 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.194195 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.194429 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.194519 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.194750 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.194846 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.195067 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.195151 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.195385 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.195476 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.195699 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.195784 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.196015 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.196155 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.196356 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.196441 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.196694 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.196781 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197015 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197100 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197332 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197422 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197655 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197746 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.197973 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.198056 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.198289 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.198373 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.198607 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.198693 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.198921 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199005 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199229 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199356 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199538 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199622 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199844 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.199936 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.200181 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.200281 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.200490 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.200574 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.200811 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.200894 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.201128 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.201220 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.201435 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.201520 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.201769 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.201902 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.202078 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.202172 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.202391 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.202475 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.202702 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.202786 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203015 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203111 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203324 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203415 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203639 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203730 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.203977 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.204077 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.204323 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.204409 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.204646 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.204772 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.204959 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205045 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205271 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205382 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205588 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205681 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205892 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.205997 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.206199 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.206293 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.206516 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.206615 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.206827 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.206916 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.207137 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.207235 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.207458 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.207562 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.207769 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.207853 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.208108 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.208205 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.208425 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.208533 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.208758 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.208848 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.209089 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.209180 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.209398 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.209501 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.209723 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.209813 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210042 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210125 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210358 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210443 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210663 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210748 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.210974 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211059 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211279 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211364 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211585 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211669 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211890 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.211974 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.212241 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.212403 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.212556 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.212731 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.212867 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.213164 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.213270 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.213467 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.213558 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.213772 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.213869 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.214097 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.214196 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.214406 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.214503 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.214713 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.214818 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215020 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215108 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215324 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215409 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215633 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215717 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.215964 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.216094 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.216308 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.216396 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.216624 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.216710 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.216940 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.217027 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.217271 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.217361 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.217592 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.217676 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.217908 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218027 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218221 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218307 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218535 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218629 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218850 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.218935 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.219162 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.219253 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.219996 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.220121 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.220349 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.220435 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.220672 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.220756 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.220984 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.221077 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.221303 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.221395 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.221611 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.221694 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.221934 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222030 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222240 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222326 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222555 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222639 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222873 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.222958 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.223206 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.223291 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.223524 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.223607 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.223848 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.223934 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.224181 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.224280 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.224502 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.224587 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.224813 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.224900 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.225128 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.225219 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.225461 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.225557 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.225753 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.225840 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.226076 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.226166 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.226389 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.226481 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.226709 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.226796 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227020 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227105 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227336 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227428 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227651 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227788 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.227972 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.228076 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.228303 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.228474 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.228622 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.228707 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.228950 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229034 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229283 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229376 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229593 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229678 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229909 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.229993 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.230218 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.230315 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.230530 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.230615 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.230841 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.230926 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.231153 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.231239 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.231460 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.231546 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.231766 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.231850 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.232094 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.232194 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.232410 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.232495 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.232721 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.232808 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233033 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233125 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233337 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233422 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233649 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233733 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.233954 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234039 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234258 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234342 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234561 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234655 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234872 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.234956 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.235210 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.235786 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236036 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236156 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236374 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236458 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236688 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236772 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.236992 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.237091 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.237298 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.237384 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.237624 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.237715 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.237933 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238029 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238239 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238323 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238545 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238629 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238849 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.238941 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.239171 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.239264 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.239488 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.239578 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.239793 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.239879 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.240124 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.240255 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.240442 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.240527 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.240751 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.240835 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.241066 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.241151 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.241376 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.241466 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.241687 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.241779 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242007 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242097 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242320 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242404 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242629 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242714 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.242939 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243025 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243249 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243342 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243560 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243656 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243872 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.243957 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.244216 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.244317 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.244526 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.244627 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.244837 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.244922 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.245149 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.245246 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.245455 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.245549 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.245765 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.245850 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.246083 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.246189 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.246396 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.246647 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.246729 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.246982 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.247080 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.247297 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.247382 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.247621 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.247710 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.247939 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.248035 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.248285 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.248531 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.248615 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.248873 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.248960 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.249198 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.249284 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.249524 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.249609 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.249850 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.249949 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.250155 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.250252 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.250462 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.250550 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.250795 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.250879 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.251100 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.251197 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.251406 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.251498 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.251710 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.251794 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252020 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252159 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252348 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252434 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252652 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252749 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.252956 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253041 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253261 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253348 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253575 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253660 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253880 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.253974 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.254193 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.254278 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.254497 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.254588 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.254819 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.254916 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.255127 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.255211 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.255429 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.255521 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.255733 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.255827 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.256038 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.256144 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.256399 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.256486 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.256707 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.256800 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257035 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257120 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257347 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257431 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257660 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257746 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.257971 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258056 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258278 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258361 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258602 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258687 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258907 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.258993 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.259213 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.259343 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.259517 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.259610 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.259826 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.259912 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.260167 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.260268 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.260472 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.260556 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.260783 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.260869 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.261093 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.261204 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.261402 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.261487 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.261712 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.261795 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262014 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262111 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262325 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262410 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262631 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262715 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.262947 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263040 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263253 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263346 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263557 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263686 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263859 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.263945 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.264191 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.264278 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.264501 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.264586 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.264805 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.264892 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.265115 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.265222 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.265418 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.265510 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.265724 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.265816 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266025 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266108 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266350 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266434 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266665 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266750 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.266976 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267059 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267286 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267381 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267593 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267677 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267906 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.267996 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.268243 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.268342 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.268550 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.268635 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.268855 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.268939 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.269166 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.269278 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.269472 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.269557 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.269776 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.269868 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.270086 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.270182 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.270409 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.270495 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.270725 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.270812 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271028 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271114 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271338 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271424 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271643 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271728 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.271948 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272033 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272279 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272364 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272589 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272684 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272893 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.272986 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.273197 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.273288 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.273503 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.273588 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.273807 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.273893 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.274111 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.274194 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.274432 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.274526 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.274742 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.274834 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275044 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275136 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275350 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275446 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275654 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275740 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.275961 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.276085 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.276314 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.276411 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.276630 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.276715 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.276943 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277028 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277258 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277351 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277572 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277665 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277883 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.277967 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.278195 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.278288 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.278509 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.278594 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.278815 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.278900 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.279130 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.279216 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.279441 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.279526 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.279754 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.279838 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.280074 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.280164 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.280383 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.280467 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.280702 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.280796 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.281015 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.281101 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.281327 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.281412 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.281644 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.281728 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.282476 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.282570 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.282795 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.282880 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.283125 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.283218 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.283434 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.283525 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.283749 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.283831 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.284074 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.284172 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.284390 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.284481 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.284701 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.284786 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.285015 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.285111 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.285328 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.285413 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.285895 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.285987 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.286210 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.286304 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.286523 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.286616 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.286832 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.286923 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.287143 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.287230 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.287455 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.287543 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.287760 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.287845 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.288100 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.288199 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.288411 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.288502 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.288716 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.288802 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289027 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289113 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289333 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289418 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289643 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289726 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.289944 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290029 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290278 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290362 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290591 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290683 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290908 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.290996 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.291222 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.291312 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.291541 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.291638 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.291853 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.291943 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.292197 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.292294 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.292515 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.292609 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.292821 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.292906 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.293221 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.293305 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.293543 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.293635 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.293860 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.293981 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.294176 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.294260 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.294482 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.294569 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.294786 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.294884 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.295097 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.295191 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.295421 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.295507 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.295727 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.295811 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296030 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296140 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296356 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296443 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296678 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296762 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.296984 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.297068 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.297305 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.297397 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.297720 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.297804 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298041 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298137 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298354 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298446 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298685 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298813 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.298998 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.299129 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.299326 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.299441 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.299749 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.299875 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.300093 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.300194 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.300411 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.300496 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.300715 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.300832 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301033 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301152 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301345 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301470 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301669 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301798 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.301992 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.302129 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.302307 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.302460 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.302626 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.302773 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.302930 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.303095 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.303252 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.303412 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.303574 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.303744 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.303888 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.304100 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.304235 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.304427 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.304649 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.304742 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.304973 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.305059 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.305286 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.305372 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.305608 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.305699 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.305933 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.306018 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.306240 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.306326 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.306544 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.306712 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.306855 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.307046 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.307161 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.307366 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.307458 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.307696 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.307785 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308030 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308192 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308364 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308453 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308677 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308764 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.308990 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.309076 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.309294 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.309379 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.309598 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.309682 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.309920 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310014 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310223 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310308 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310540 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310637 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310851 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.310935 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.311166 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.311252 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.311475 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.311568 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.311777 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.311869 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.312118 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.312217 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.312431 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.312525 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.312734 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.312817 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.313041 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.313127 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.313877 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.313991 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.314222 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.314316 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.314532 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.314618 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.314852 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.314937 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.315168 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.315251 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.315483 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.315567 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.315797 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.315889 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.316132 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.316220 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.316468 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.316551 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.316783 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.316871 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.317100 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.317184 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.317425 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.317510 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.317730 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.317816 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318043 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318156 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318425 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318535 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318659 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318748 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.318965 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319053 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319268 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319365 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319576 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319663 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319879 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.319964 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.320208 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.320309 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.320514 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.320599 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.320835 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.320921 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.321141 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.321234 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.321458 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.321543 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.321765 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.321850 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.322069 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.322155 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.322375 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.322460 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.322677 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.322761 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323004 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323123 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323312 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323397 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323638 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323722 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.323954 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.324039 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.324290 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.324380 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.324603 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.324688 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.324916 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325004 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325236 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325326 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325574 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325677 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325870 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.325955 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.326189 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.326275 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.326508 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.326605 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.326826 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.326910 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.327143 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.327236 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.327463 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.327556 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.327774 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.327866 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.328118 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.328207 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.328436 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.328572 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.328759 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.328850 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.329626 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.329819 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.329954 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.330154 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.330281 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.330471 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.330599 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.330789 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.330914 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.331104 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.331234 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.331422 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.331561 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.331738 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.332069 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.332167 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.332389 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.332474 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.332702 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.332787 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333018 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333104 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333349 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333433 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333670 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333763 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.333994 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.334086 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.334320 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.334406 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.334636 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.334733 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.334952 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.335037 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.335271 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.335357 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.335584 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.335677 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.335921 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.336007 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.336279 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.336379 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.336625 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.336712 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.336952 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337100 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337278 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337363 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337602 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337692 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337915 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.337998 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.338233 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.338327 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.338549 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.338679 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.338865 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.338950 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.339178 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.339273 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.339490 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.339575 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.339810 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.339901 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.340152 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.340241 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.340480 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.340567 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.340804 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.340889 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.341123 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.341208 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.341438 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.341522 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.341754 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.341839 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.342071 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.342157 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.342394 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.342587 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.342728 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.342903 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.343071 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.343235 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.343400 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.343560 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.343723 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.343883 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.344085 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.344228 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.344391 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.344574 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.344908 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345006 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345217 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345309 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345526 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345611 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345840 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.345935 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.346153 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.346238 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.346461 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.346545 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.346786 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.346888 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.347099 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.347184 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.347404 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.347489 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.347791 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.348132 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.348460 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.348777 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.349111 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.349437 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.349753 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.350085 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.350405 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.350946 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.351299 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.351631 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.351762 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.351964 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.352323 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.352653 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.352969 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.353303 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.353619 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.353934 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.354265 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.354585 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.354899 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.355215 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.355536 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.355667 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.355853 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.356189 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.356392 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.356682 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.356810 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.356995 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.357146 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.357433 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.357531 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.357760 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.357858 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.358074 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.358169 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.358397 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.358498 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.358711 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.358797 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359025 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359115 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359337 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359432 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359650 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359737 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.359969 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.360570 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.360822 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.360921 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.361140 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.361235 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.361453 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.361539 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.361775 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.361867 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.362086 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.362171 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.362396 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.362480 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.362705 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.362791 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363016 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363100 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363352 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363436 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363667 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363754 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.363983 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.364088 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.364326 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.364411 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.364645 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.364731 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.364958 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365043 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365270 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365362 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365582 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365669 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365895 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.365988 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.366216 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.366456 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.366544 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.366798 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.366884 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.367127 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.367212 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.367441 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.367526 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.367752 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.367837 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.368087 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.368178 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.368402 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.368490 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.368718 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.368810 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.369076 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.369161 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.369386 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.369473 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.369706 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.369792 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370022 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370120 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370351 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370438 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370669 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370799 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.370985 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.371081 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.371301 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.371386 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.371622 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.371751 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.371944 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.372192 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.372282 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.372534 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.372631 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.372862 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.372956 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.373202 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.373288 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.373537 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.373622 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.373851 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.373945 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.374163 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.374249 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.374473 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.374566 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.374795 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.374888 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.375110 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.375219 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.375425 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.375521 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.375790 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.376400 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.376622 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.376707 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.376940 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.377025 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.377259 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.377346 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.377575 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.377659 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.377889 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378002 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378204 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378326 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378518 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378655 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378832 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.378987 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.379150 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.379309 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.379495 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.379640 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.379820 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.379972 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.380164 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.380319 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.380487 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.380648 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.380816 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.380970 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.381132 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.381307 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.381448 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.381651 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.381764 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.381990 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.382077 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.382324 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.382409 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.382638 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.382736 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.382953 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.383038 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.383268 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.383353 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.383587 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.383712 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.383926 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.384032 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.384291 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.384379 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.384621 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.384717 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.384953 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.385040 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.385273 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.385358 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.385602 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.385689 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.385922 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386009 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386245 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386330 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386562 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386654 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386884 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.386969 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.387203 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.387288 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.387542 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.387629 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.387863 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.387950 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.388202 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.388307 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.388516 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.388601 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.388828 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.388913 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.389143 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.389236 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.389459 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.389544 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.389794 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.389897 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.390111 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.390204 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.390430 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.390516 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.390749 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.390833 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.391073 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.391165 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.391429 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.391565 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.391751 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.391837 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.392091 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.392179 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.392415 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.392499 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.392730 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.392826 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.393053 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.393139 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.393368 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.393452 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.393686 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.393776 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394001 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394086 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394316 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394400 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394632 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394725 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.394950 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.395036 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.395282 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.395374 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.395612 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.395705 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.395923 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.396015 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.396275 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.396362 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.396596 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.396692 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.396919 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397003 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397238 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397324 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397556 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397649 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397866 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.397950 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.398116 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 04:06:39.398209 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.398493 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.398808 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.399125 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.399445 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.399766 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.400123 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.400453 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.400788 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.401116 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.401468 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.401785 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.402133 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.402463 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.402779 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.403093 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.403401 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:06:39.403648 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 04:06:39.421285 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_db.sqlalchemy.engines [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.426042 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_db.sqlalchemy.engines [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.487324 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.context [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bf556a-fe9c-41c3-88b0-1429f117219c(cell1) {{(pid=102031) load_cells /opt/stack/nova/nova/context.py:464}} Feb 07 04:06:39.489749 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.context [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bf556a-fe9c-41c3-88b0-1429f117219c(cell1) {{(pid=102030) load_cells /opt/stack/nova/nova/context.py:464}} Feb 07 04:06:39.491458 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:06:39.493091 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:06:39.493876 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_concurrency.lockutils [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:06:39.493970 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:06:39.495464 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_concurrency.lockutils [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:06:39.495854 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:06:39.496297 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_concurrency.lockutils [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:06:39.498232 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_concurrency.lockutils [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:06:39.508587 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_db.sqlalchemy.engines [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.511302 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_db.sqlalchemy.engines [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.512595 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_db.sqlalchemy.engines [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.515553 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_db.sqlalchemy.engines [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.681308 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG oslo_db.sqlalchemy.engines [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:39.684128 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_db.sqlalchemy.engines [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:06:40.020833 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: WARNING keystonemiddleware.auth_token [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:06:40.024241 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: WARNING keystonemiddleware.auth_token [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:06:40.027452 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: WARNING keystonemiddleware.auth_token [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:06:40.030901 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: WARNING keystonemiddleware.auth_token [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:06:40.365747 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: WARNING keystonemiddleware.auth_token [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:06:40.369937 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: WARNING keystonemiddleware.auth_token [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:06:40.370845 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: WARNING keystonemiddleware.auth_token [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:06:40.375386 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: WARNING keystonemiddleware.auth_token [None req-65a541e0-87cd-4566-9626-b198bb52b3f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:06:40.376770 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e1d6809c0 pid: 102030 (default app) Feb 07 04:06:40.378815 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:06:40.379968 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Feb 07 04:06:40.380403 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Feb 7 04:06:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:06:40.381171 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e1d6809c0 pid: 102031 (default app) Feb 07 04:08:04.791185 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:04.792239 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Feb 07 04:08:04.792630 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:05.225036 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-98c51870-e719-47f6-9e23-1b1763b17b3e admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:05.255457 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-98c51870-e719-47f6-9e23-1b1763b17b3e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.455334 Feb 07 04:08:05.255898 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Feb 7 04:08:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:07.515103 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:07.516389 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-5096dd55-a29b-41fd-b583-b8aa8e482b31 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Feb 07 04:08:07.516793 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:07.582283 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7621e833-cf11-4ffb-a118-71526e2cf724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "id": "c1", "swap": 0}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:07.600685 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:08:07.600685 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: warnings.warn(msg) Feb 07 04:08:07.629998 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7621e833-cf11-4ffb-a118-71526e2cf724 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106639 Feb 07 04:08:07.630773 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:08:07.854145 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-8271d539-aece-4547-be87-a04229176943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:07.856569 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:08:07.856569 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: warnings.warn(msg) Feb 07 04:08:07.905513 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-8271d539-aece-4547-be87-a04229176943 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265576 Feb 07 04:08:07.909458 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Feb 7 04:08:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:10.150559 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7621e833-cf11-4ffb-a118-71526e2cf724 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:10.151566 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7621e833-cf11-4ffb-a118-71526e2cf724 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Feb 07 04:08:10.151971 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:10.262077 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-e920ce91-f21d-4162-bb8f-db60d85caa19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:10.283491 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:08:10.283491 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: warnings.warn(msg) Feb 07 04:08:10.304486 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-e920ce91-f21d-4162-bb8f-db60d85caa19 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145823 Feb 07 04:08:10.305175 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:08:10.317370 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-0baa95c6-fbe8-4817-a099-d8fb2028ca52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:10.318837 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:08:10.318837 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: warnings.warn(msg) Feb 07 04:08:10.350635 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-0baa95c6-fbe8-4817-a099-d8fb2028ca52 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036755 Feb 07 04:08:10.351132 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Feb 7 04:08:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:08:12.604730 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-e920ce91-f21d-4162-bb8f-db60d85caa19 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:12.605741 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-e920ce91-f21d-4162-bb8f-db60d85caa19 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 07 04:08:12.606139 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:12.669049 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7b9ae44a-2d90-4377-b707-f7c1fad95174 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:12.690320 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7b9ae44a-2d90-4377-b707-f7c1fad95174 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077120 Feb 07 04:08:12.691040 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:08:12.703608 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-81efe124-2099-4ec0-b2cb-23003eb6cb83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:12.729459 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-81efe124-2099-4ec0-b2cb-23003eb6cb83 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029756 Feb 07 04:08:12.739210 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Feb 7 04:08:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:15.021789 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7b9ae44a-2d90-4377-b707-f7c1fad95174 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:15.022852 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7b9ae44a-2d90-4377-b707-f7c1fad95174 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Feb 07 04:08:15.023256 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:15.081619 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-3295d456-7d4f-4d0c-9781-c79cb9e68cfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "disk": 10}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:15.099696 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-3295d456-7d4f-4d0c-9781-c79cb9e68cfa admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070462 Feb 07 04:08:15.100582 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:08:15.112007 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-56aebaae-9bed-4ac4-b954-4d2c2bb4c040 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:15.137394 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-56aebaae-9bed-4ac4-b954-4d2c2bb4c040 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029024 Feb 07 04:08:15.137980 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Feb 7 04:08:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:08:17.417723 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-3295d456-7d4f-4d0c-9781-c79cb9e68cfa admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:17.418734 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-3295d456-7d4f-4d0c-9781-c79cb9e68cfa admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Feb 07 04:08:17.419132 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:17.477822 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7f772e77-09b1-4cb2-8bc9-006f634ec79d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "swap": 0, "name": "ds4G", "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:17.497529 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7f772e77-09b1-4cb2-8bc9-006f634ec79d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071777 Feb 07 04:08:17.499202 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:08:17.510518 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-3b94f584-a9c8-420e-8e1c-0b226c9aef3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:17.534350 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-3b94f584-a9c8-420e-8e1c-0b226c9aef3c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027400 Feb 07 04:08:17.535164 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Feb 7 04:08:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:19.777151 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7f772e77-09b1-4cb2-8bc9-006f634ec79d admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:19.778151 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7f772e77-09b1-4cb2-8bc9-006f634ec79d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Feb 07 04:08:19.778551 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:19.835625 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-30ef280b-1b4a-4654-be52-61553d990ad5 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:19.859532 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-30ef280b-1b4a-4654-be52-61553d990ad5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074511 Feb 07 04:08:19.860075 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Feb 7 04:08:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:22.159356 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7f772e77-09b1-4cb2-8bc9-006f634ec79d admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:22.160688 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7f772e77-09b1-4cb2-8bc9-006f634ec79d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001798 Feb 07 04:08:22.161090 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:22.229765 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-8631bfec-e4ad-4078-a472-ba619b05df9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "vcpus": 1, "name": "m1.tiny"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:22.247608 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-8631bfec-e4ad-4078-a472-ba619b05df9e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080560 Feb 07 04:08:22.248178 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:08:22.259714 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-45fa1f55-d339-4dfb-8d66-8f0a2deb79b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:22.283442 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-45fa1f55-d339-4dfb-8d66-8f0a2deb79b8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027266 Feb 07 04:08:22.284062 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Feb 7 04:08:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:08:25.070644 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-8631bfec-e4ad-4078-a472-ba619b05df9e admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:25.071657 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-8631bfec-e4ad-4078-a472-ba619b05df9e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Feb 07 04:08:25.072079 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:25.137162 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7aadca03-7568-4789-b5da-9b2501e04071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:25.163102 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7aadca03-7568-4789-b5da-9b2501e04071 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081548 Feb 07 04:08:25.164060 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:08:25.176156 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-72530c7d-36ef-45e7-a84d-7f39893f419a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:25.204297 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-72530c7d-36ef-45e7-a84d-7f39893f419a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031618 Feb 07 04:08:25.204991 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Feb 7 04:08:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:27.466590 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7aadca03-7568-4789-b5da-9b2501e04071 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:27.467637 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7aadca03-7568-4789-b5da-9b2501e04071 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Feb 07 04:08:27.468065 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:27.525630 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-bef2f0ea-6afc-4da4-b3af-88dec1d004ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "name": "m1.medium"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:27.543276 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-bef2f0ea-6afc-4da4-b3af-88dec1d004ba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068916 Feb 07 04:08:27.543824 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:08:27.556131 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-a3a56a1d-e051-4a0a-8e72-e92761df66a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:27.578264 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-a3a56a1d-e051-4a0a-8e72-e92761df66a4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025769 Feb 07 04:08:27.578830 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Feb 7 04:08:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:08:29.859720 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-bef2f0ea-6afc-4da4-b3af-88dec1d004ba admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:29.860780 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-bef2f0ea-6afc-4da4-b3af-88dec1d004ba admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Feb 07 04:08:29.861178 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:29.927421 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-b67c72df-3a63-47be-8320-f59c2d6592d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "id": "4"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:29.947322 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-b67c72df-3a63-47be-8320-f59c2d6592d3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079501 Feb 07 04:08:29.948552 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:08:29.959810 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-68d4a2ac-42b7-4214-a583-f44c40eef319 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:29.984492 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-68d4a2ac-42b7-4214-a583-f44c40eef319 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028123 Feb 07 04:08:29.992398 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Feb 7 04:08:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:32.259313 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-b67c72df-3a63-47be-8320-f59c2d6592d3 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:32.260416 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-b67c72df-3a63-47be-8320-f59c2d6592d3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Feb 07 04:08:32.260824 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:32.353291 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-fc55fac1-465e-43d5-81ec-9abd4d6cf5f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "swap": 0, "disk": 160}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:32.372999 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-fc55fac1-465e-43d5-81ec-9abd4d6cf5f1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.104439 Feb 07 04:08:32.373742 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Feb 7 04:08:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:08:32.386360 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-e95f5c2f-3a8a-41cc-b21e-ed64c15f3e8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:08:32.409264 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-e95f5c2f-3a8a-41cc-b21e-ed64c15f3e8a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027704 Feb 07 04:08:32.410272 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Feb 7 04:08:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:08:54.768214 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-fc55fac1-465e-43d5-81ec-9abd4d6cf5f1 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:54.769213 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-fc55fac1-465e-43d5-81ec-9abd4d6cf5f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 07 04:08:54.769604 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:54.825469 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7c1a1b48-d96e-4547-91e4-f8ea12f134b6 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:54.842873 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7c1a1b48-d96e-4547-91e4-f8ea12f134b6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067312 Feb 07 04:08:54.843410 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Feb 7 04:08:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:56.199068 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-fc55fac1-465e-43d5-81ec-9abd4d6cf5f1 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:56.200081 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-fc55fac1-465e-43d5-81ec-9abd4d6cf5f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Feb 07 04:08:56.200481 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:56.402745 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-08999c4d-b025-41b1-a4eb-c39daec53a06 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:56.408746 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.wsgi [None req-08999c4d-b025-41b1-a4eb-c39daec53a06 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 07 04:08:56.409237 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-08999c4d-b025-41b1-a4eb-c39daec53a06 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:08:56.410275 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-08999c4d-b025-41b1-a4eb-c39daec53a06 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057857 Feb 07 04:08:56.410778 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Feb 7 04:08:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 07 04:08:56.420604 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-d56e4216-7fb0-434e-94cc-ce9cb418ffee admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:56.440489 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-d56e4216-7fb0-434e-94cc-ce9cb418ffee admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023938 Feb 07 04:08:56.441002 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Feb 7 04:08:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:56.450258 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-e0d6869b-7c8b-4f1b-9cac-a99c0803f321 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:56.471055 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-e0d6869b-7c8b-4f1b-9cac-a99c0803f321 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024255 Feb 07 04:08:56.471579 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Feb 7 04:08:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:56.480328 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-ad2aeaf0-dc82-458b-86cd-9b3d80d7b693 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:56.485640 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.wsgi [None req-ad2aeaf0-dc82-458b-86cd-9b3d80d7b693 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 07 04:08:56.486202 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-ad2aeaf0-dc82-458b-86cd-9b3d80d7b693 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:08:56.486996 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-ad2aeaf0-dc82-458b-86cd-9b3d80d7b693 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010089 Feb 07 04:08:56.487463 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Feb 7 04:08:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 07 04:08:57.750792 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-e0d6869b-7c8b-4f1b-9cac-a99c0803f321 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:57.751784 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-e0d6869b-7c8b-4f1b-9cac-a99c0803f321 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Feb 07 04:08:57.752206 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:57.944366 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-8902f9cd-7e0e-4f5a-bd42-90fc23f98672 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:57.950240 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.wsgi [None req-8902f9cd-7e0e-4f5a-bd42-90fc23f98672 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 07 04:08:57.951328 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-8902f9cd-7e0e-4f5a-bd42-90fc23f98672 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:08:57.952158 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-8902f9cd-7e0e-4f5a-bd42-90fc23f98672 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058033 Feb 07 04:08:57.952682 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Feb 7 04:08:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 07 04:08:57.961891 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f37988e3-85e0-470a-bc77-288a0851b0d5 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:57.976137 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f37988e3-85e0-470a-bc77-288a0851b0d5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017759 Feb 07 04:08:57.976648 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Feb 7 04:08:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:57.985463 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-9c9af2a4-15ae-4578-be53-4e05abfdfcca admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:57.998965 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-9c9af2a4-15ae-4578-be53-4e05abfdfcca admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016870 Feb 07 04:08:57.999475 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Feb 7 04:08:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:58.008191 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-aecce769-c5df-4cbd-b356-c248f246c86b admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:58.013855 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.wsgi [None req-aecce769-c5df-4cbd-b356-c248f246c86b admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 07 04:08:58.014410 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-aecce769-c5df-4cbd-b356-c248f246c86b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:08:58.015184 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-aecce769-c5df-4cbd-b356-c248f246c86b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010408 Feb 07 04:08:58.015664 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Feb 7 04:08:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 07 04:08:59.293982 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-9c9af2a4-15ae-4578-be53-4e05abfdfcca admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:59.294979 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-9c9af2a4-15ae-4578-be53-4e05abfdfcca admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Feb 07 04:08:59.295367 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:08:59.489610 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-b4442c79-dd66-4eaf-8cac-88a3f8490dc4 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:59.494836 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.wsgi [None req-b4442c79-dd66-4eaf-8cac-88a3f8490dc4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 07 04:08:59.495387 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-b4442c79-dd66-4eaf-8cac-88a3f8490dc4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:08:59.496198 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-b4442c79-dd66-4eaf-8cac-88a3f8490dc4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056337 Feb 07 04:08:59.496699 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Feb 7 04:08:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 07 04:08:59.506397 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-749f7f44-a6c0-49f9-b675-7778529a740f admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:59.521244 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-749f7f44-a6c0-49f9-b675-7778529a740f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018455 Feb 07 04:08:59.521762 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Feb 7 04:08:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:59.531244 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:59.544372 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016923 Feb 07 04:08:59.544893 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Feb 7 04:08:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:08:59.553557 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-dd5e4bdb-0f44-4748-942f-04292493beb0 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:08:59.558538 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.wsgi [None req-dd5e4bdb-0f44-4748-942f-04292493beb0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 07 04:08:59.559086 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-dd5e4bdb-0f44-4748-942f-04292493beb0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:08:59.560390 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-dd5e4bdb-0f44-4748-942f-04292493beb0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010202 Feb 07 04:08:59.560863 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Feb 7 04:08:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 07 04:09:00.851984 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:00.853049 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 07 04:09:00.853447 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:09:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:09:01.045820 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-bdb8e854-4982-4a60-8ece-ae2ce5b4cecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:09:01.062984 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-bdb8e854-4982-4a60-8ece-ae2ce5b4cecc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068789 Feb 07 04:09:01.063505 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Feb 7 04:09:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:09:02.340932 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:02.341936 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Feb 07 04:09:02.342341 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:09:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:09:02.531285 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-d507fbbb-85bc-42ea-b60b-682a6cc92810 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:09:02.549207 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-d507fbbb-85bc-42ea-b60b-682a6cc92810 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069544 Feb 07 04:09:02.549801 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Feb 7 04:09:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:09:03.828379 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:03.829412 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Feb 07 04:09:03.829809 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:09:04.023149 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-0505b361-15c0-49ff-939b-3cc87f9d358b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:09:04.040894 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-0505b361-15c0-49ff-939b-3cc87f9d358b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070555 Feb 07 04:09:04.041418 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Feb 7 04:09:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:09:05.299300 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:05.300324 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Feb 07 04:09:05.300750 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:09:05.489521 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-653eb64a-5cfe-4faa-b6f4-2fc7d849133b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:09:05.506949 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-653eb64a-5cfe-4faa-b6f4-2fc7d849133b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067373 Feb 07 04:09:05.507488 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Feb 7 04:09:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:09:06.771643 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:06.772680 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Feb 07 04:09:06.773073 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:09:06.961161 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-4297e484-23d5-4e39-bf96-62e53b8fc2a4 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:06.979481 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-4297e484-23d5-4e39-bf96-62e53b8fc2a4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069204 Feb 07 04:09:06.979993 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Feb 7 04:09:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:09:52.668404 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:52.669398 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-f2659e4e-0444-442b-ad01-86cf4479cdf9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Feb 07 04:09:52.669791 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon Feb 7 04:09:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:09:52.725836 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-bee80496-719f-4b22-b668-5d739b1c417b admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:52.744253 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-bee80496-719f-4b22-b668-5d739b1c417b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068868 Feb 07 04:09:52.744775 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Feb 7 04:09:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:09:52.767997 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-432dd3c5-9bd5-4a97-9f65-638bbf6c8b1c admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:52.775626 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-432dd3c5-9bd5-4a97-9f65-638bbf6c8b1c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011316 Feb 07 04:09:52.776229 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Feb 7 04:09:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:09:52.787859 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-50f9785e-3d3c-4594-ad9d-804f1d03277a admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:52.795310 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-50f9785e-3d3c-4594-ad9d-804f1d03277a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010958 Feb 07 04:09:52.795811 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Feb 7 04:09:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:09:52.806199 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-51aeacf0-030d-413f-9da4-4d8d45640dc5 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:52.813924 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-51aeacf0-030d-413f-9da4-4d8d45640dc5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011027 Feb 07 04:09:52.814428 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Feb 7 04:09:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:09:52.825693 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:09:52.832958 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011165 Feb 07 04:09:52.833469 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Feb 7 04:09:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:11:23.330873 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-4102a546-a603-45eb-8da6-ea3880e4df87 tempest-verify_tempest_config-84603572 tempest-verify_tempest_config-84603572-project] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:11:23.332849 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-4102a546-a603-45eb-8da6-ea3880e4df87 tempest-verify_tempest_config-84603572 tempest-verify_tempest_config-84603572-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103759 Feb 07 04:11:23.333392 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Feb 7 04:11:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:12:52.331427 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:12:52.332493 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Feb 07 04:12:52.332886 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:12:52.589903 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-7d651dde-8e63-4391-8ae3-04f183daff45 admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:12:52.591056 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:12:52.591056 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: warnings.warn(msg) Feb 07 04:12:52.592617 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-7d651dde-8e63-4391-8ae3-04f183daff45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:12:52.593059 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-7d651dde-8e63-4391-8ae3-04f183daff45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:12:52.593858 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-7d651dde-8e63-4391-8ae3-04f183daff45 admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:12:52.594284 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-7d651dde-8e63-4391-8ae3-04f183daff45 admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:12:52.626972 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-7d651dde-8e63-4391-8ae3-04f183daff45 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149405 Feb 07 04:12:52.627515 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 35/71] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Feb 7 04:12:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:12:53.921065 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:12:53.922061 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Feb 07 04:12:53.922459 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:12:54.113142 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-2d1f5edc-14e5-42c9-93a8-02eeb35cf1fa admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:12:54.114310 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:12:54.114310 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: warnings.warn(msg) Feb 07 04:12:54.115839 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-2d1f5edc-14e5-42c9-93a8-02eeb35cf1fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:12:54.116316 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-2d1f5edc-14e5-42c9-93a8-02eeb35cf1fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:12:54.117150 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-2d1f5edc-14e5-42c9-93a8-02eeb35cf1fa admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:12:54.118161 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-2d1f5edc-14e5-42c9-93a8-02eeb35cf1fa admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:12:54.137353 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-2d1f5edc-14e5-42c9-93a8-02eeb35cf1fa admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074641 Feb 07 04:12:54.137845 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 36/73] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Feb 7 04:12:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:13:05.861410 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:13:05.862398 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 07 04:13:05.862787 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 38/74] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:13:06.051007 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-5fa8ce18-9542-4dfa-836f-70bb538833ee admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:13:06.052191 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:13:06.052191 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: warnings.warn(msg) Feb 07 04:13:06.053711 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-5fa8ce18-9542-4dfa-836f-70bb538833ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:13:06.054175 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-5fa8ce18-9542-4dfa-836f-70bb538833ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:13:06.054974 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-5fa8ce18-9542-4dfa-836f-70bb538833ee admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:13:06.055406 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-5fa8ce18-9542-4dfa-836f-70bb538833ee admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:13:06.079098 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-5fa8ce18-9542-4dfa-836f-70bb538833ee admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078223 Feb 07 04:13:06.079590 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 37/75] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Feb 7 04:13:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:13:07.401146 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: DEBUG nova.api.openstack.wsgi [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] Calling method '>' {{(pid=102030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:13:07.402146 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: INFO nova.api.openstack.requestlog [None req-164dfbe0-7d49-49ee-811f-99930a8bd217 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Feb 07 04:13:07.402536 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: [pid: 102030|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Feb 7 04:13:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:13:07.595738 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG nova.api.openstack.wsgi [None req-d49394c3-4ece-457f-8940-35a6fec259bb admin admin] Calling method '>' {{(pid=102031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:13:07.596917 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:13:07.596917 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: warnings.warn(msg) Feb 07 04:13:07.598482 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-d49394c3-4ece-457f-8940-35a6fec259bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:13:07.598990 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-d49394c3-4ece-457f-8940-35a6fec259bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:13:07.599811 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-d49394c3-4ece-457f-8940-35a6fec259bb admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:13:07.600295 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: DEBUG oslo_concurrency.lockutils [None req-d49394c3-4ece-457f-8940-35a6fec259bb admin admin] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:13:07.622423 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: INFO nova.api.openstack.requestlog [None req-d49394c3-4ece-457f-8940-35a6fec259bb admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080110 Feb 07 04:13:07.622954 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: [pid: 102031|app: 0|req: 38/77] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Feb 7 04:13:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:14:04.434542 dv-cinder-799631-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 07 04:14:04.435416 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: Mon Feb 7 04:14:04 2022 - graceful shutdown triggered... Feb 07 04:14:04.435915 dv-cinder-799631-7-iscsi devstack@n-api.service[102030]: Gracefully killing worker 1 (pid: 102030)... Feb 07 04:14:04.436309 dv-cinder-799631-7-iscsi devstack@n-api.service[102031]: Gracefully killing worker 2 (pid: 102031)... Feb 07 04:14:05.436542 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: worker 1 buried after 1 seconds Feb 07 04:14:05.437008 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: worker 2 buried after 1 seconds Feb 07 04:14:05.437008 dv-cinder-799631-7-iscsi devstack@n-api.service[102029]: goodbye to uWSGI. Feb 07 04:14:05.438081 dv-cinder-799631-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 07 04:14:05.438630 dv-cinder-799631-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 07 04:14:05.441381 dv-cinder-799631-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 07 04:14:05.457575 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 7 04:14:05 2022] *** Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: nodename: dv-cinder-799631-7-iscsi Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: machine: x86_64 Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: clock source: unix Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: pcre jit disabled Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: detected number of CPU cores: 4 Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: current working directory: / Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: detected binary path: /usr/bin/uwsgi-core Feb 07 04:14:05.459598 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: your processes number limit is 47680 Feb 07 04:14:05.460549 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: your memory page size is 4096 bytes Feb 07 04:14:05.460549 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: detected max file descriptor number: 2048 Feb 07 04:14:05.460549 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: lock engine: pthread robust mutexes Feb 07 04:14:05.460549 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: thunder lock: enabled Feb 07 04:14:05.460549 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 07 04:14:05.460549 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 07 04:14:05.508735 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: Python main interpreter initialized at 0x5596877049c0 Feb 07 04:14:05.508735 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: python threads support enabled Feb 07 04:14:05.508735 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: your server socket listen backlog is limited to 100 connections Feb 07 04:14:05.508735 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: your mercy for graceful operations on workers is 90 seconds Feb 07 04:14:05.509162 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: mapped 403077 bytes (393 KB) for 2 cores Feb 07 04:14:05.509162 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: *** Operational MODE: preforking *** Feb 07 04:14:05.509357 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: *** uWSGI is running in multiple interpreter mode *** Feb 07 04:14:05.509357 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: spawned uWSGI master process (pid: 116472) Feb 07 04:14:05.509560 dv-cinder-799631-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 07 04:14:05.510150 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: spawned uWSGI worker 1 (pid: 116492, cores: 1) Feb 07 04:14:05.510687 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: spawned uWSGI worker 2 (pid: 116493, cores: 1) Feb 07 04:14:05.510977 dv-cinder-799631-7-iscsi devstack@n-api.service[116472]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 07 04:14:07.480587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:14:07.480587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: from cryptography.utils import int_from_bytes Feb 07 04:14:07.481285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:14:07.481285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: from cryptography.utils import int_from_bytes Feb 07 04:14:07.482751 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:14:07.482751 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: from cryptography.utils import int_from_bytes Feb 07 04:14:07.483216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 04:14:07.483216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: from cryptography.utils import int_from_bytes Feb 07 04:14:09.921723 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 04:14:09.922228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 04:14:09.922497 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 04:14:09.922861 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 04:14:09.923116 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 04:14:09.923505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.923832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.924190 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.924512 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.924844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.925453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.925787 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.926134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.926493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.926698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.927017 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.927135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 04:14:09.927556 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 04:14:09.927642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799631-7-iscsi {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.927642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.927911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 04:14:09.928009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.928274 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.928373 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 04:14:09.928597 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.928704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 04:14:09.928903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.929011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.929228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.929332 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.929546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.929649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.929950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.930055 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.930294 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.930479 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.930608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.930788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.930931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.931102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.931271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.931445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.931611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.931744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.931882 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.932104 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.932254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.932392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.932580 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799631-7-iscsi {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.933261 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.933429 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.933590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.933750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.933896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.934074 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.934291 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799631-7-iscsi {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.934432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.934611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.934750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.934925 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.935076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.935242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.935374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.935657 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.935837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.935992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.936199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.936329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.936490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.936624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.936813 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.936955 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.937161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.937302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.937488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.937628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.937810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.937957 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.938133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.938265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.938451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.938616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.938747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.938887 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799631-7-iscsi {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.939988 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.940146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.940330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.940463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.940603 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.940857 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941179 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941323 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.941958 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942617 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.942917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.943108 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.943242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.943435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.943575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.943765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.943897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.944096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.944245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.944418 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.944565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.944724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.944856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945033 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945342 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.945934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.946070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.946199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.946330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.946527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.946729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.946867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.947004 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.947172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.947314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.947866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948006 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948617 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948890 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.948967 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949108 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949904 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.949992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.950221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.950303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.950539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.950627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.950856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.950943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.952862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.953490 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.953490 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.953769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.953914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954314 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954864 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.954999 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955126 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955266 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955547 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.955944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956114 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956672 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956672 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.956936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957072 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957214 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957617 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.957894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958151 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958291 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958848 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.958986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959393 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959530 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959804 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.959935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960780 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.960908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961593 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961720 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.961989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962509 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962780 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.962922 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963101 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963238 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963646 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.963918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964675 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964810 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.964947 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.965891 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966028 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966337 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966474 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.966880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.967016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.967144 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.967278 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.967478 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.967616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.967753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.967889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.968027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.968219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.968352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.968494 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.968623 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.968750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.968886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.969028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.969165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.969302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.969432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.969567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.969695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.969835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.969972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.970109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.970238 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.970365 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.970502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.970631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.970758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.970898 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.971027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.971163 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.971300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.971438 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.971574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.971699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.971825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.971960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.972154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.972293 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.972423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.972552 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.972690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 04:14:09.972820 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.972962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.973959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974655 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.974960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.975102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.975284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.975417 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.975620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.975755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.975945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.976114 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.976293 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.976435 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.976617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.976753 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.976945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.977088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.977264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.977396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.977585 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.977727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.977899 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978213 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.978973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.979154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.979296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980020 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980185 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980828 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.980997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.981135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.981319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.981452 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.981634 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.981769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.981954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.982088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.982267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.982399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.982573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.982719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.982880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983499 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983633 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.983937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.984151 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.984297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.984481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.984615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.984791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.984931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.985126 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.985266 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.985436 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.985567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.985752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.985883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.986064 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.986207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.986380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.986527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.986687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.986828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987447 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.987948 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.988111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.988285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.988427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.988593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.988726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.988903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989657 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.989975 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.990141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.990272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.990453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.990585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.990765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.990909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.991087 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.991220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.991401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.991542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.991716 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.991857 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.992196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.992332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.992463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.992592 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.992738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.992867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.993922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.994052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.994220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.994362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.994526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.994668 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.994831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.995083 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.995710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.995853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.995992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.996143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.996295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.996427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.996605 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.996748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.996912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997053 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997359 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.997979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.998158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.998298 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.998463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.998596 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.998770 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.998912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.999076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.999285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.999425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.999555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.999715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:09.999850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.000099 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.000250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.000415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.000557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.000737 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.000878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001055 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001812 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.001998 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.002143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.002311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.002451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.002621 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.002752 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.002930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.003070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.003239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.003370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.003551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.003685 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.003864 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004807 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.004949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.005127 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.005269 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.005435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.005574 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.005750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.005892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.006088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.006220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.006419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.006550 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.006734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.006868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007057 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.007997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.008181 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.008320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.008449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.008632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.008766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.008943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.009076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.009263 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.009403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.009574 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.009782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.009913 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010040 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010192 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010513 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010847 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.010987 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.011165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.011307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.011470 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.011604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.011791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.011923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.012139 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.012279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.012472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.012611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.012785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.012931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.013098 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.013239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.013419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.013553 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.013731 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.013872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.014042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.014176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.014355 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.014489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.014660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.014801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015271 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015566 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.015876 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016356 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016520 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.016969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.017146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.017285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.017450 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.017584 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.017754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.017888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.018066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.018198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.018389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.018534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.018703 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.018842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019484 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.019951 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.020190 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.020331 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.020470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.020601 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.020736 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.020874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021613 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021829 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.021962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.022140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.022281 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.022443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.022576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.022754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.022887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023087 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.023979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.024161 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.024326 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.024467 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.024656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.024788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.024975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.025110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.025318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.025447 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.025583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.025721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.025885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.026020 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.026720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.026974 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.027116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.027290 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.027423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.027616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.027749 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.027928 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.028090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.028265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.028407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.028575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.028714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.028881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.029022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.029191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.029324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.029510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.029642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.029866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.030082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.030225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.030417 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.030798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.030992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.031132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.031315 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.031522 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.031654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.031783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.031947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.032118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.032311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.032454 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.032632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.032771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.032944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.033082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.033258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.033391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.033575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.033709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.033881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034188 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034810 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.034951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.035119 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.035250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.035424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.035570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.035737 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.035871 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.036059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.036357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.036508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.036667 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.036798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.036975 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.037108 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.037292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.037438 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.037598 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.037739 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.037912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038684 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.038998 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.039166 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.039312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.039472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.039613 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.039780 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.039922 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.040148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.040283 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.040460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.040603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.040771 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.040903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.041086 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.041218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.041401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.041533 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.041723 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.041912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.042618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.042953 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.043106 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.043252 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.043563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.043872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.044201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.044343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.044514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.044640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.044824 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.045012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.045153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.045438 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.045610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.045751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.046054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.046191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.046361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.046663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.046788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.046969 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.047087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.047287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.047478 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.047596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.047895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.048094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.048241 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.048521 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.048833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.049140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.049267 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.049455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.049612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.049760 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.049955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.050089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.050334 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.050476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.050665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.050796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.050973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.051113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.051287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.051428 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.051598 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.051732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.051903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.052067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.052252 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.052385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.052571 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.052715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.052880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053235 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053377 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053781 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.053942 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.054076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.054273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.054408 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.054593 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.054725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.054925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.055066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.055504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.055645 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.055775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.055922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056233 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056770 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.056900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057337 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057668 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057802 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.057973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.058114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.058279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.058413 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.058604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.058738 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.058919 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059051 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059371 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059836 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.059976 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.060204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.060357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.060511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.060653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.060874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061007 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061184 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061643 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.061960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.062140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.062284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.062458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.062590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.062776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.062916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.063083 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.063224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.063399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.063538 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.063708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.063839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064198 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064336 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064477 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.064961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.065101 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.065277 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.065410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.065591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.065731 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.065913 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066544 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066676 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066848 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.066981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.067158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.067299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.067470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.067611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.067779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.067909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.068110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.068248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.068424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.068574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.068735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.068875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069045 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069498 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.069984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.070124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.070292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.070511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.070662 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.070794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.070929 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071198 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071513 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.071967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.072157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.072290 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.072465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.072599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.072775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.072914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.073108 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.073245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.073418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.073551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.073815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.073955 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.074137 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.074281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.074455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.074586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.074764 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.074914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.075073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.075216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.075385 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.075524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.075705 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.075852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.076022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.076192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.076353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.076493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.076697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.076842 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077826 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.077963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.078100 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.078272 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.078412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.078585 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.078719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.078909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079040 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079662 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079829 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.079969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.080174 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.080306 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.080480 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.080613 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.080803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.080945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.081127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.081260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.081448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.081584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.081765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.081906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.082101 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.082359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.082491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.082621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.082739 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.082865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083036 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083178 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083820 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.083988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.084185 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.084380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.084512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.084695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.084836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.085986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.086131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.086295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.086435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.086620 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.086768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.086933 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.087065 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.087249 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.087389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.087575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.087709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.087981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.088226 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.088359 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.088488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.088616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.089273 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.089455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.089599 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.089780 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.089914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.090091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.090236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.090400 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.090540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.090715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.090862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091008 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091147 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091316 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091447 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.091949 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.092106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.092283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.092431 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.092596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.092742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.092912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.093044 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.093219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.093434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.093568 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.093760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.093894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.094082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.094253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.094416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.094558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.094741 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.094886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.095065 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.095199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.095380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.095525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.095685 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.095818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.096960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.097093 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.097267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.097409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.097613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.097754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.097920 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.098063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.098245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.098388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.098572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.098711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.098901 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.099031 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.099214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.099356 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.099550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.099691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.099876 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100356 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.100988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.101162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.101296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.101466 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.101599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.101778 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.101920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.102067 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.102198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.102377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.102511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.102742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.102888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103282 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.103878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.104018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.104224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.104397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.105135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.105348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.105489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.105618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.105747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.105888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.106058 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.106206 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.106366 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.106498 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.106670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.106805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107153 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107317 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107457 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.107962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.108121 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.108313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.108450 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.108617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.108751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.108932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.109071 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.109259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.109394 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.109592 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.109724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.109913 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.110045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.110232 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.110366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.110551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.110693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.110870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111187 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.111948 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.112155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.112300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.112472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.112615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.112782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.112922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.113105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.113324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.113473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.113845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.113980 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114666 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.114925 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115760 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.115893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.116098 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.116250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.116393 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.116523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.116720 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.116859 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.117043 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.117190 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.117370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.117510 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.117704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.117850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118157 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118341 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118658 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.118973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.119112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.119316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.119457 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.119638 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.119785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.119985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.120178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.120357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.120501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.120677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.120820 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.120993 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.121127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.121308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.121451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.121622 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.121767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.121938 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.122073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.122254 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.122395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.122569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.122712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.122883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.123018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.123203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.123342 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.123516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.123657 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.123842 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.124096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.124247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.124424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.124567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.124750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.124883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.125073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.125207 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.125398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.125533 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.125728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.125918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.126052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.126238 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.126385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.126570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.126704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.126896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.127030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.127278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.127493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.127633 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.127822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.127964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.128166 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.128312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.128495 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.128629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.128803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.128936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.129111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.129258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.129424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.129558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.129738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.129879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.130044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.130222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.130360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.130497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.130715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.130857 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.131003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.131142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.131279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.131410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.131576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.131710 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.132028 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.132185 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.132380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.132522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.132702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.132836 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.133987 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.134122 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.134307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.134440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.134613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.134752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.134923 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.135057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.135240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.135373 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.135564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.135716 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.135881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.136023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.136212 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.136358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.136526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.136779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.136922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.137105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.137246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.137429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.137637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.137769 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.137898 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138048 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138499 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.138972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.139107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.139284 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.139430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.139591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.139726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.139897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140031 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140377 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.140988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.141161 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.141298 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.141475 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.141615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.141801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.141941 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.142113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.142254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.142423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.142650 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.142784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143468 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.143984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.144170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.144332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.144474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.144647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.144781 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.144987 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.145119 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.145276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.145417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.145590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.145724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.145910 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.146043 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.146231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.146373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.146546 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.146779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.146962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.147094 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.147231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.147407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.147548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.147742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.147884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.148085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.148220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.148397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.148529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.148706 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.148840 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149641 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.149956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.150086 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.150266 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.150398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.150574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.150707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.150886 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.151026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.151705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.151851 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152824 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.152992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.153132 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.153304 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.153434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.153616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.153772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.153938 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.154080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.154253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.154387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.154571 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.154717 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.154893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.155034 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.155214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.155347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.155529 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.155922 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.156140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.156272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.156413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.156551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.156724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.156862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157692 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.157999 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.158252 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.158418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.158599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.158741 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.158937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.159070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.159285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.159418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.159628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.159774 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.159948 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.160136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.160278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.160414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.160598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.160740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.160922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.161054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.161239 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.161382 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.161560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.161693 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.161884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.162977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.163153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.163296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.163465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.163597 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.163779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.163913 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.164121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.164273 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.164446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.164591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.164764 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.164895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.165092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.165234 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.165406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.165540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.165729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.165863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.166044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.166186 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.166367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.166509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.166685 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.166853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.167557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.167700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.167881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.168013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.168230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.168364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.168557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.168704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.168875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.169961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.170138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.170281 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.170466 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.170600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.170792 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.170934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.171102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.171244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.171429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.171563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.171750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.171885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.172095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.172234 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.172419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.172555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.172734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.172877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.173067 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.173209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.173384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.173518 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.173710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.173852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174481 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174809 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.174979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.175113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.175302 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.175442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.175627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.175841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.175983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.176165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.176296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.176424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.176628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.176775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.176945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.177080 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.177273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.177413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.177594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.177741 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.177911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.178043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.178227 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.178360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.178537 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.178672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.178801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 04:14:10.178931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.179185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.179510 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.179832 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.180178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.180504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.180827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.181151 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.181486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.181819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.182135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.182492 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.182822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.183155 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.183483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.183804 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.184175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.184500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.184827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.185149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.185470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.185800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.186128 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.186464 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.186798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.187135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.187473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.187828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.188182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.188539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.188878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.189203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.189525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.189841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 04:14:10.190092 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 04:14:10.201343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_db.sqlalchemy.engines [None req-9d097763-5204-4743-b406-9f90baa1256d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.212640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.267814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.context [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bf556a-fe9c-41c3-88b0-1429f117219c(cell1) {{(pid=116492) load_cells /opt/stack/nova/nova/context.py:464}} Feb 07 04:14:10.272056 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:10.273664 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:10.274475 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:10.277308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:10.278845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.context [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bf556a-fe9c-41c3-88b0-1429f117219c(cell1) {{(pid=116493) load_cells /opt/stack/nova/nova/context.py:464}} Feb 07 04:14:10.283418 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:10.287011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:10.287011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:10.287922 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:10.288211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_db.sqlalchemy.engines [None req-9d097763-5204-4743-b406-9f90baa1256d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.289167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_db.sqlalchemy.engines [None req-9d097763-5204-4743-b406-9f90baa1256d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.300858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.302148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.450580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_db.sqlalchemy.engines [None req-9d097763-5204-4743-b406-9f90baa1256d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.462818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 04:14:10.777822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: WARNING keystonemiddleware.auth_token [None req-9d097763-5204-4743-b406-9f90baa1256d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:14:10.784664 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: WARNING keystonemiddleware.auth_token [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:14:10.791073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: WARNING keystonemiddleware.auth_token [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:14:10.797875 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: WARNING keystonemiddleware.auth_token [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:14:11.128482 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: WARNING keystonemiddleware.auth_token [None req-9d097763-5204-4743-b406-9f90baa1256d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:14:11.133879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: WARNING keystonemiddleware.auth_token [None req-9d097763-5204-4743-b406-9f90baa1256d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:14:11.139631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596877049c0 pid: 116492 (default app) Feb 07 04:14:11.140714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: WARNING keystonemiddleware.auth_token [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 07 04:14:11.146054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: WARNING keystonemiddleware.auth_token [None req-f4a82f6f-2921-4044-afba-e53861e3c611 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 07 04:14:11.151474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596877049c0 pid: 116493 (default app) Feb 07 04:14:46.820642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1106814725", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "fd1dc6a2-5aea-4548-b35e-164b66095f17"}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:46.884258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8014888a-e217-4ae2-bb81-65221508ae70 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Action: 'create', calling method: .version_select at 0x7f91812e7280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-222822442", "metadata": {"Type": "work"}}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:46.893239 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8014888a-e217-4ae2-bb81-65221508ae70 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:46.894395 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8014888a-e217-4ae2-bb81-65221508ae70 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.502376 Feb 07 04:14:46.895062 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Feb 7 04:14:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1505 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:14:47.227659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d6adab32-d5a9-4346-83ad-e861099bce9d tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Action: 'create', calling method: .version_select at 0x7f91812e7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1942451604", "metadata": {"Type": "work"}}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:47.367450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] validate_networks() for [('fd1dc6a2-5aea-4548-b35e-164b66095f17', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:14:48.047363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d6adab32-d5a9-4346-83ad-e861099bce9d tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.150943 Feb 07 04:14:48.048944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Feb 7 04:14:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1153 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 07 04:14:48.319359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1112278763", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "7ca219ba-88c9-4d7f-a70f-fc6411c07502"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:48.553434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] validate_networks() for [('7ca219ba-88c9-4d7f-a70f-fc6411c07502', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:14:48.849411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:14:48.850396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:14:48.851198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:14:48.851896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:14:48.852365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:14:48.869480 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:48.870335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:48.872602 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:48.873052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:48.908595 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Getting quotas for project 015f07f102774e9f9465bcf4e71744f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:14:48.914821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Getting quotas for user d72c1b5afcb048559a9602b9a2ed9ab2 and project 015f07f102774e9f9465bcf4e71744f6. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:14:48.926735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:14:48.929888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:14:49.015004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ac642a43-a34d-439a-b8c6-2769e9b96bf2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.207676 Feb 07 04:14:49.015975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:14:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:14:49.022375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b76e2b0c-0363-4fa5-985c-744b05d0cfb7 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Action: 'create', calling method: .version_select at 0x7f91808d4dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-697102534", "metadata": {"Type": "work"}}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:49.024889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b76e2b0c-0363-4fa5-985c-744b05d0cfb7 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:49.026012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b76e2b0c-0363-4fa5-985c-744b05d0cfb7 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008750 Feb 07 04:14:49.032963 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 2/4] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Feb 7 04:14:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:14:49.041425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-712d864b-b2e8-469b-a492-5861102d8375 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Calling method '.version_select at 0x7f91808f1670>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:49.169193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-712d864b-b2e8-469b-a492-5861102d8375 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2" status: 200 len: 353 microversion: 2.1 time: 0.134983 Feb 07 04:14:49.170030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:49 2022] GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:49.178599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6d54fcd1-ea6b-411d-9d04-8d758576b314 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:49.179566 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6d54fcd1-ea6b-411d-9d04-8d758576b314 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:49.304258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6d54fcd1-ea6b-411d-9d04-8d758576b314 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:49.328434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6d54fcd1-ea6b-411d-9d04-8d758576b314 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1215 microversion: 2.1 time: 0.157109 Feb 07 04:14:49.329203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:49 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:49.333800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-21d2cb1f-4bc1-4611-9c5a-382063d982f5 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Action: 'create', calling method: .version_select at 0x7f918006fdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1506238863", "metadata": {"Type": "work"}}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:49.334889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-21d2cb1f-4bc1-4611-9c5a-382063d982f5 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:49.337032 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-21d2cb1f-4bc1-4611-9c5a-382063d982f5 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006696 Feb 07 04:14:49.338539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 5/7] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Feb 7 04:14:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:14:49.347462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7786a66f-f877-4aba-bde0-ed054bf0a204 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Calling method '.version_select at 0x7f9180075310>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:49.394830 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-7786a66f-f877-4aba-bde0-ed054bf0a204 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] HTTP exception thrown: Volume tempest-invalid-1267839985 could not be found. Feb 07 04:14:49.395741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7786a66f-f877-4aba-bde0-ed054bf0a204 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Returning 404 to user: Volume tempest-invalid-1267839985 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:49.396840 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7786a66f-f877-4aba-bde0-ed054bf0a204 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1267839985" status: 404 len: 99 microversion: 2.1 time: 0.053036 Feb 07 04:14:49.398460 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 6/8] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Feb 7 04:14:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1267839985 => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 07 04:14:49.409836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f8da4701-efaf-446d-a860-2f89639d4728 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005846 Feb 07 04:14:49.412388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 7/9] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Feb 7 04:14:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 07 04:14:49.426262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-47e92a84-c39c-41fb-8c07-7ed812f4d668 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006968 Feb 07 04:14:49.427708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 8/10] 10.222.0.13 () {58 vars in 1136 bytes} [Mon Feb 7 04:14:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 07 04:14:49.440122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-202cd990-492b-4c6f-bf43-f8a840927ad6 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Calling method '.version_select at 0x7f91808f1550>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:49.487591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-202cd990-492b-4c6f-bf43-f8a840927ad6 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] HTTP exception thrown: Volume aa42e688-fe6a-49b8-9fc1-1c62f8a38017 could not be found. Feb 07 04:14:49.488447 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-202cd990-492b-4c6f-bf43-f8a840927ad6 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Returning 404 to user: Volume aa42e688-fe6a-49b8-9fc1-1c62f8a38017 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:49.489468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-202cd990-492b-4c6f-bf43-f8a840927ad6 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/aa42e688-fe6a-49b8-9fc1-1c62f8a38017" status: 404 len: 109 microversion: 2.1 time: 0.057611 Feb 07 04:14:49.490589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 9/11] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Feb 7 04:14:49 2022] DELETE /compute/v2.1/os-volumes/aa42e688-fe6a-49b8-9fc1-1c62f8a38017 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:14:49.500760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1cb7e922-2b5e-476b-9a19-0768504f8479 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f918004d9d0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:49.600776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1cb7e922-2b5e-476b-9a19-0768504f8479 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/bafa6a78-7e16-493c-8064-cd20a322f633" status: 200 len: 350 microversion: 2.1 time: 0.108194 Feb 07 04:14:49.601355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 10/12] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:49 2022] GET /compute/v2.1/os-volumes/bafa6a78-7e16-493c-8064-cd20a322f633 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:49.606265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bc85212f-1319-4a66-b7cd-9052086deb63 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Calling method '.version_select at 0x7f9180075790>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:49.671114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-bc85212f-1319-4a66-b7cd-9052086deb63 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] HTTP exception thrown: Volume 816327d9-9643-438c-a9ce-b5e0440851de could not be found. Feb 07 04:14:49.671717 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bc85212f-1319-4a66-b7cd-9052086deb63 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] Returning 404 to user: Volume 816327d9-9643-438c-a9ce-b5e0440851de could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:49.672659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bc85212f-1319-4a66-b7cd-9052086deb63 tempest-VolumesNegativeTest-354478878 tempest-VolumesNegativeTest-354478878-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/816327d9-9643-438c-a9ce-b5e0440851de" status: 404 len: 109 microversion: 2.1 time: 0.070392 Feb 07 04:14:49.673441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 11/13] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:49 2022] GET /compute/v2.1/os-volumes/816327d9-9643-438c-a9ce-b5e0440851de => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:14:49.746427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:14:49.748189 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:14:49.749114 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:14:49.749822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:14:49.750628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:14:49.788314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:49.791209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:49.792504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:49.793105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:49.871522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:14:49.883209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for user 4d4bef2b813144fab2053b3547694bbe and project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:14:49.913206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:14:49.921900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:14:50.108230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-052fd548-9082-4995-87e8-619104ee6a8d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057663 Feb 07 04:14:50.113891 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 3/14] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:14:50.120442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5fe3cff5-fab4-4c35-adae-493e592ab0cc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:50.121715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5fe3cff5-fab4-4c35-adae-493e592ab0cc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:50.182818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7bec0e19-49eb-4a15-b279-9c0ec34ebbdf tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Calling method '.version_select at 0x7f918083e5e0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:50.303555 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7bec0e19-49eb-4a15-b279-9c0ec34ebbdf tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2" status: 200 len: 354 microversion: 2.1 time: 0.124952 Feb 07 04:14:50.304563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 4/15] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:50 2022] GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:14:50.321766 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0e05dc6f-d9f2-433b-8083-ad596007303b tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Calling method '.version_select at 0x7f918083eee0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:50.425790 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5fe3cff5-fab4-4c35-adae-493e592ab0cc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:50.441180 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0e05dc6f-d9f2-433b-8083-ad596007303b tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2" status: 200 len: 354 microversion: 2.1 time: 0.124796 Feb 07 04:14:50.442082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 5/16] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:50 2022] GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:50.467378 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-39fc4fdc-4aac-4701-b1c5-e9560f4cef6d tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:50.468057 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-39fc4fdc-4aac-4701-b1c5-e9560f4cef6d tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:50.478321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5fe3cff5-fab4-4c35-adae-493e592ab0cc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1218 microversion: 2.1 time: 0.362279 Feb 07 04:14:50.499068 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 12/17] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:50 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1218 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:50.518358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-367a935b-5906-4e10-9fdc-4f3ef51fe220 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Calling method '.version_select at 0x7f9180075820>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:50.666989 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-367a935b-5906-4e10-9fdc-4f3ef51fe220 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2" status: 202 len: 0 microversion: 2.1 time: 0.166689 Feb 07 04:14:50.667762 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 13/18] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Feb 7 04:14:50 2022] DELETE /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:14:50.676605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4c273ac5-ab8e-4b8d-beed-7e35838c8fb9 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Calling method '.version_select at 0x7f918005bdc0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:50.799374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4c273ac5-ab8e-4b8d-beed-7e35838c8fb9 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2" status: 200 len: 353 microversion: 2.1 time: 0.127054 Feb 07 04:14:50.802073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 14/19] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:50 2022] GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:51.025409 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-39fc4fdc-4aac-4701-b1c5-e9560f4cef6d tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:51.070627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-39fc4fdc-4aac-4701-b1c5-e9560f4cef6d tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1215 microversion: 2.1 time: 0.614219 Feb 07 04:14:51.077926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 6/20] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:50 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1215 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:51.137894 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1b26005b-557e-4931-8b3e-200e36870f06 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f917bfcf1f0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:51.210047 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1b26005b-557e-4931-8b3e-200e36870f06 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ad8eb96b-784b-4b95-b059-6ac67a12bd07" status: 200 len: 351 microversion: 2.1 time: 0.077668 Feb 07 04:14:51.210995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 15/21] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:51 2022] GET /compute/v2.1/os-volumes/ad8eb96b-784b-4b95-b059-6ac67a12bd07 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:51.506109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f8396715-d456-4b50-95a5-c3db513bb359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:51.506932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f8396715-d456-4b50-95a5-c3db513bb359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:51.814653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e1db5239-f4d2-4c74-a98d-4a970203b867 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Calling method '.version_select at 0x7f918005bee0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:51.867634 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-e1db5239-f4d2-4c74-a98d-4a970203b867 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] HTTP exception thrown: Volume c6d6e869-48f0-4504-9feb-d23bc50920a2 could not be found. Feb 07 04:14:51.868500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e1db5239-f4d2-4c74-a98d-4a970203b867 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] Returning 404 to user: Volume c6d6e869-48f0-4504-9feb-d23bc50920a2 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:14:51.870325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e1db5239-f4d2-4c74-a98d-4a970203b867 tempest-VolumesGetTestJSON-368235340 tempest-VolumesGetTestJSON-368235340-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2" status: 404 len: 109 microversion: 2.1 time: 0.060702 Feb 07 04:14:51.871231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 16/22] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:51 2022] GET /compute/v2.1/os-volumes/c6d6e869-48f0-4504-9feb-d23bc50920a2 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 07 04:14:52.094652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:52.097235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:52.112952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:52.113403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:52.114209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:52.114677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:52.369257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f8396715-d456-4b50-95a5-c3db513bb359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:52.380564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f8396715-d456-4b50-95a5-c3db513bb359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1218 microversion: 2.1 time: 0.877095 Feb 07 04:14:52.389415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 7/23] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:51 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1218 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:52.699706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:52.731476 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-de009912-5be2-4b67-b5ba-fbd1c5897fec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1273 microversion: 2.1 time: 0.640383 Feb 07 04:14:52.734517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 17/24] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:52 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1273 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:14:53.145815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-42caf6a0-50f1-4298-8de7-b5c361756ab6 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f918087a3a0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:53.237880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-42caf6a0-50f1-4298-8de7-b5c361756ab6 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/a350eba2-391f-4001-9db1-fe16aaee5ed3" status: 200 len: 351 microversion: 2.1 time: 0.100982 Feb 07 04:14:53.238843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 8/25] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:14:53 2022] GET /compute/v2.1/os-volumes/a350eba2-391f-4001-9db1-fe16aaee5ed3 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:53.253494 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f687b5e0-b328-4839-8cfe-cf084eee7da3 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f917bf598b0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:53.406786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:53.407399 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:53.418788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:53.422924 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:53.426561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:53.428608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:53.524150 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f687b5e0-b328-4839-8cfe-cf084eee7da3 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.276189 Feb 07 04:14:53.524903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 18/26] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Feb 7 04:14:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:53.538797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3b99451a-2752-45d8-9bce-542d257d53ad tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f91808d4e50>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:53.833715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3b99451a-2752-45d8-9bce-542d257d53ad tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.298655 Feb 07 04:14:53.842544 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 19/27] 10.222.0.13 () {58 vars in 1148 bytes} [Mon Feb 7 04:14:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:53.848236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:53.849029 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:53.892071 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:53.894025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:53.902066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:53.903651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:53.958324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:53.996858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b9a330d1-ae8a-4b64-aa11-fd5d22c3b66c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1276 microversion: 2.1 time: 0.594522 Feb 07 04:14:53.999699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 9/28] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:53 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1276 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:14:54.010902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ca4403cc-b80e-4e93-80e8-81ff0bd409e0 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f917bf5e790>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:54.202008 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ca4403cc-b80e-4e93-80e8-81ff0bd409e0 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.200958 Feb 07 04:14:54.202663 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 10/29] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Feb 7 04:14:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:54.214502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3f00e4e5-119c-4274-af0d-a3e40dcdc345 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f917bfd0670>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:54.562100 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3f00e4e5-119c-4274-af0d-a3e40dcdc345 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.351109 Feb 07 04:14:54.563518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 11/30] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Feb 7 04:14:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:14:54.576776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-af0aee02-21be-45c6-8b5b-fbfb6d95c6e5 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f917bf7eee0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:54.777276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-af0aee02-21be-45c6-8b5b-fbfb6d95c6e5 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.205981 Feb 07 04:14:54.777848 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1169 bytes} [Mon Feb 7 04:14:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:14:54.782563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:54.791336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4cf8674a-c2bb-4254-abd9-6a5acb3da6b8 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1273 microversion: 2.1 time: 0.947364 Feb 07 04:14:54.794177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 20/32] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:53 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1273 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:54.794570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ac87af93-f2f5-463e-89e9-a66b4d31b59c tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f918087a550>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:55.044807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:55.044807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:55.044807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:55.044807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:55.051285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:55.051285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:55.085840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ac87af93-f2f5-463e-89e9-a66b4d31b59c tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.296495 Feb 07 04:14:55.086750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 13/33] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Feb 7 04:14:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:55.102150 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-40abe26a-4e9e-490b-808f-db1f3a6abb2a tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f91812e7a60>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:55.437164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-40abe26a-4e9e-490b-808f-db1f3a6abb2a tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.342920 Feb 07 04:14:55.438112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 14/34] 10.222.0.13 () {58 vars in 1187 bytes} [Mon Feb 7 04:14:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:14:55.449887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-59eeeda9-917f-43d1-88db-aac6835f6481 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] Calling method '.version_select at 0x7f917bf0cc10>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:55.692419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-59eeeda9-917f-43d1-88db-aac6835f6481 tempest-VolumesTestJSON-1376372628 tempest-VolumesTestJSON-1376372628-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.246279 Feb 07 04:14:55.693733 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 15/35] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Feb 7 04:14:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:14:55.826500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:55.827631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:55.839909 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:55.844760 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:55.846155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:55.846832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:56.018222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:56.026146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-369ccdce-01e6-45cb-a895-76c83c9a0aa0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1276 microversion: 2.1 time: 1.011232 Feb 07 04:14:56.030626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 21/36] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:55 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1276 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:14:56.095845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:56.105182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d19bca85-3d79-4554-817f-3f930c6293c1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1273 microversion: 2.1 time: 0.291195 Feb 07 04:14:56.115109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 16/37] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:55 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:14:57.048226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:57.050258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:57.087056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:57.090114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:57.092136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:57.094722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:57.140258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:57.142136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:57.169524 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:57.172725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:57.181799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:57.182980 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:57.515466 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:57.524640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2546c951-116d-4e6c-988f-6ae5c1e8807c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1276 microversion: 2.1 time: 0.481023 Feb 07 04:14:57.543879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 22/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:57 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1276 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:14:58.365474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7eb683ca-f0a3-45a3-a209-6578c4f2c684 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'create', calling method: .version_select at 0x7f917bf72c10>, body: {"keypair": {"name": "tempest-keypair-1941670958"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:14:58.420388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-7eb683ca-f0a3-45a3-a209-6578c4f2c684 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:14:58.428449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-7eb683ca-f0a3-45a3-a209-6578c4f2c684 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for user 9140d220db624cf89b9e010215040eb2 and project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:14:58.727253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:14:58.748279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ad96f18e-d737-4fae-84b4-721293041282 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 1.617050 Feb 07 04:14:58.770210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 17/39] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:57 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:14:58.782827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:58.784446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:58.797048 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:58.797764 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:58.799427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:58.800210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:59.778655 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-7eb683ca-f0a3-45a3-a209-6578c4f2c684 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:14:59.791432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-7eb683ca-f0a3-45a3-a209-6578c4f2c684 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for user 9140d220db624cf89b9e010215040eb2 and project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:14:59.840408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7eb683ca-f0a3-45a3-a209-6578c4f2c684 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.826466 Feb 07 04:14:59.847445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 23/40] 10.222.0.13 () {62 vars in 1198 bytes} [Mon Feb 7 04:14:58 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1834 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 07 04:14:59.857040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:14:59.858131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:14:59.874504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:59.875445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:14:59.877629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:14:59.878236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:01.491242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:01.502358 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9ccd12ce-f19c-4648-96d2-3bbfab1a94dd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 2.730569 Feb 07 04:15:01.502968 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 18/41] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:58 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:02.302721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:02.312570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a2e6910d-d6ce-4b94-927b-c90506c001b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 2.463631 Feb 07 04:15:02.318470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 24/42] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:14:59 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:02.520576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:02.521822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:02.535759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:02.536230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:02.537035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:02.537474 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:03.334892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:03.335596 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:03.347011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:03.347011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:03.347319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:03.347686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:04.414847 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:04.462816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-95585b63-16a3-4055-8c93-72e1efa6de21 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 1.110247 Feb 07 04:15:04.466721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 25/43] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:03 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:04.468356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:04.477705 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-45dd53fc-ee62-4046-a94c-f935bca89872 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 1.960089 Feb 07 04:15:04.481845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 19/44] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:02 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:05.206954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-21b1836a-e264-479b-ba1d-da7c487e4930 req-60809b72-838c-484d-b55f-d888d328c91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79993cf3-effd-4ca7-9f63-a643a924216d", "tag": "b5d10650-f8c5-427c-8472-0a665ca4301f"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:05.217722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:05.217722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:15:05.248874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-696563418", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:05.260713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-21b1836a-e264-479b-ba1d-da7c487e4930 req-60809b72-838c-484d-b55f-d888d328c91c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:05.263763 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-21b1836a-e264-479b-ba1d-da7c487e4930 req-60809b72-838c-484d-b55f-d888d328c91c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:05.357177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-21b1836a-e264-479b-ba1d-da7c487e4930 req-60809b72-838c-484d-b55f-d888d328c91c service nova] Creating event network-changed:b5d10650-f8c5-427c-8472-0a665ca4301f for instance 79993cf3-effd-4ca7-9f63-a643a924216d on hv-cinder-79963 Feb 07 04:15:05.359113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] validate_networks() for [('1c81d0d0-d615-4849-87d4-dae2587ee669', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:15:05.363232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-21b1836a-e264-479b-ba1d-da7c487e4930 req-60809b72-838c-484d-b55f-d888d328c91c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 07 04:15:05.369922 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:05.371490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:05.377346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:05.392924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:05.431465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.compute.rpcapi [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 07 04:15:05.441504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] Releasing lock "compute-rpcapi-router" {{(pid=116493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 07 04:15:05.497197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e8ae7b7b-fb3f-47fc-9b3e-2114fb0e8337 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.027871 Feb 07 04:15:05.498880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 26/45] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:05.516975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:05.520219 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:05.540862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:05.542509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:05.545558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:05.548853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:06.463250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:06.496236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-255cf363-002d-4de8-884b-ab5d0256e529 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.994852 Feb 07 04:15:06.497876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 27/46] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:05 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:06.510253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:06.514741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:06.532244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:06.533562 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:06.537345 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:06.538122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:07.052156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:07.061352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-014f44f1-17df-449e-8f14-f12df0343329 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.559839 Feb 07 04:15:07.062638 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 28/47] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:06 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:07.414241 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:15:07.414759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:15:07.415125 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:15:07.415591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:15:07.416379 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:15:07.430737 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:07.431564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:07.432608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:07.435621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:07.474965 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Getting quotas for project e9eb47ba0e1b464fac1b4fccbd4905ec. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:15:07.485318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Getting quotas for user f949f46f3cd34ff28833d743c16b4f99 and project e9eb47ba0e1b464fac1b4fccbd4905ec. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:15:07.508008 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-0bf19487-9a60-4023-9f42-b0b3d692e5a4 req-1e415fe1-bfe3-4943-99fe-310f02101969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ab83aa-0797-44a0-b215-5bfdf13708e8", "tag": "7316a72a-35b8-43ff-990d-60cf1f6bb7d6"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:07.511069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:15:07.511250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:07.511250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:15:07.513343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:15:07.525474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-0bf19487-9a60-4023-9f42-b0b3d692e5a4 req-1e415fe1-bfe3-4943-99fe-310f02101969 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:07.529892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-0bf19487-9a60-4023-9f42-b0b3d692e5a4 req-1e415fe1-bfe3-4943-99fe-310f02101969 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:07.557305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-0bf19487-9a60-4023-9f42-b0b3d692e5a4 req-1e415fe1-bfe3-4943-99fe-310f02101969 service nova] Creating event network-changed:7316a72a-35b8-43ff-990d-60cf1f6bb7d6 for instance 31ab83aa-0797-44a0-b215-5bfdf13708e8 on hv-cinder-79963 Feb 07 04:15:07.573950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-0bf19487-9a60-4023-9f42-b0b3d692e5a4 req-1e415fe1-bfe3-4943-99fe-310f02101969 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.505593 Feb 07 04:15:07.575293 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 29/48] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:07.586200 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:07.588912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:07.602694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:07.603994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:07.604982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:07.605639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:07.613740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1d7d47e1-7dfd-4dc4-a7f9-d317a5cfab55 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.694158 Feb 07 04:15:07.617593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 20/49] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:15:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:15:07.626049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-554b185e-0f50-4149-8ee8-405ecaebd761 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:07.632297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-554b185e-0f50-4149-8ee8-405ecaebd761 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:07.740722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-554b185e-0f50-4149-8ee8-405ecaebd761 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:07.758708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-554b185e-0f50-4149-8ee8-405ecaebd761 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1221 microversion: 2.1 time: 0.137630 Feb 07 04:15:07.763907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 21/50] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:07 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:08.082373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:08.083133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:08.101522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:08.106046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:08.109382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:08.111499 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:08.227208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:08.235791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-29b858f8-246c-4529-b8a6-9979f9fff1f7 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.658604 Feb 07 04:15:08.238928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 30/51] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:07 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:08.427932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1601504062", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:08.553275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] validate_networks() for [('1c81d0d0-d615-4849-87d4-dae2587ee669', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:15:09.055225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:09.066796 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e99fe7ea-1803-4dd0-9263-da239849b4fe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.990557 Feb 07 04:15:09.082534 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 22/52] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:08 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:09.090628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1413892917", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "035a4eca-c650-4fdd-bb42-ea519a7b428e"}], "security_groups": [{"name": "tempest-securitygroup--750705470"}], "key_name": "tempest-keypair-1941670958", "user_data": "}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:09.526360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] validate_networks() for [('035a4eca-c650-4fdd-bb42-ea519a7b428e', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:15:09.803112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:15:09.803671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:15:09.805749 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:15:09.806279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:15:09.806819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:15:09.838993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:09.846920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:09.848288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:09.856455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:09.895929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Getting quotas for project e9eb47ba0e1b464fac1b4fccbd4905ec. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:15:09.908113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Getting quotas for user f949f46f3cd34ff28833d743c16b4f99 and project e9eb47ba0e1b464fac1b4fccbd4905ec. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:15:09.937161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:15:09.939690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:15:10.104689 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-73fb0e9e-3be0-4cf6-a000-f7b0820ac2d5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.683657 Feb 07 04:15:10.108910 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 31/53] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:15:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:15:10.115789 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:10.116497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:10.127672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:10.128650 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:10.129928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:10.130513 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:10.624573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:10.635930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8cd17907-d790-4ba2-8223-6affbbc8f059 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.524274 Feb 07 04:15:10.637740 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 32/54] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:10 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:10.651350 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:10.652774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:10.667663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:10.671044 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:10.674097 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:10.675408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:10.945215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:10.971365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a83aa837-34d7-495e-ac11-719b6b832e7d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.332371 Feb 07 04:15:10.972796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 33/55] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:10 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:11.006283 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:11.007711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:11.023397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:11.024448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:11.026600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:11.027254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:11.188232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:11.195894 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5e4fd27f-bc91-4fbf-85a1-f97872a84bca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1226 microversion: 2.1 time: 0.218812 Feb 07 04:15:11.199374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 34/56] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:10 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1226 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:11.260934 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:15:11.261418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:15:11.262629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:15:11.263103 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:15:11.263565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:15:11.278186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:11.280505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:11.282388 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:11.282917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:11.305673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for project aafc4147461248299eee9b97ebd42995. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:15:11.312893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for user 9140d220db624cf89b9e010215040eb2 and project aafc4147461248299eee9b97ebd42995. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:15:11.373229 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:15:11.376154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:15:11.454197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d6e0cb97-066b-4856-8a59-98d54e2a1dc7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.370296 Feb 07 04:15:11.459390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 23/57] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Feb 7 04:15:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 07 04:15:11.473407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e65b9291-160c-478d-9994-2ccc46baaff1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:11.474257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e65b9291-160c-478d-9994-2ccc46baaff1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:11.590354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e65b9291-160c-478d-9994-2ccc46baaff1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:11.598271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e65b9291-160c-478d-9994-2ccc46baaff1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:11.600174 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e65b9291-160c-478d-9994-2ccc46baaff1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:11.601295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e65b9291-160c-478d-9994-2ccc46baaff1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1282 microversion: 2.20 time: 0.138747 Feb 07 04:15:11.601858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 35/58] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:11 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:11.656701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:11.657387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:11.667862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:11.668352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:11.669159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:11.669602 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:11.993920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:11.995935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:12.010384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:12.011542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:12.014499 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:12.015605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:12.119295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:12.127542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c49e2871-9397-4645-a941-6a5bfdcb44ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.476215 Feb 07 04:15:12.131421 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 24/59] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:11 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:12.214857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:12.215540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:12.223816 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:12.224994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:12.230906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:12.231939 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:12.412314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:12.430636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1697605c-e4a2-41be-bc7d-9a6e888bab34 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1280 microversion: 2.1 time: 0.219602 Feb 07 04:15:12.433033 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 25/60] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:12 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:12.486610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:12.496661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8df77c2d-d7b5-4a49-95fe-72eccb0de399 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.507294 Feb 07 04:15:12.499691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 36/61] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:11 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:12.621724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:12.624031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:12.637342 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:12.639721 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:12.645324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:12.649180 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:12.825751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:12.837582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:12.843478 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:12.848092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7657e748-3cee-4bb9-bff1-86c973f07a0a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1334 microversion: 2.20 time: 0.232389 Feb 07 04:15:12.849819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 26/62] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:12 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1334 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:13.002809 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-b35129fb-02cb-426d-86c8-29376fbd1a20 req-924f690a-cb11-4ff4-abe4-3777ef3fd865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb55652-6b90-48a0-8c34-def2934ea25d", "tag": "08a3936d-26aa-4031-920c-7291ded7d6bc"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:13.005419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:13.005419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:15:13.021625 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-b35129fb-02cb-426d-86c8-29376fbd1a20 req-924f690a-cb11-4ff4-abe4-3777ef3fd865 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.022505 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-b35129fb-02cb-426d-86c8-29376fbd1a20 req-924f690a-cb11-4ff4-abe4-3777ef3fd865 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.063948 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-b35129fb-02cb-426d-86c8-29376fbd1a20 req-924f690a-cb11-4ff4-abe4-3777ef3fd865 service nova] Creating event network-changed:08a3936d-26aa-4031-920c-7291ded7d6bc for instance 8bb55652-6b90-48a0-8c34-def2934ea25d on hv-cinder-79963 Feb 07 04:15:13.071284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-b35129fb-02cb-426d-86c8-29376fbd1a20 req-924f690a-cb11-4ff4-abe4-3777ef3fd865 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072830 Feb 07 04:15:13.073185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 37/63] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:13.147958 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:13.148618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:13.163613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.164096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.164984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.165467 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.449555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:13.450226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:13.469861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.470323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.471125 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.471564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.765338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:13.778148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4d739a20-d99b-4a1e-b38c-2651893179b0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.633779 Feb 07 04:15:13.778972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 27/64] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:13 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:13.787950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:13.796380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:13.807588 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.808359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.809448 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.810094 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.893654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:13.905484 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-520832e3-c572-4c10-bf76-8b39903f6380 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.459273 Feb 07 04:15:13.908925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 38/65] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:13 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:13.914180 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:13.926377 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:13.941819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.948361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:13.950074 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:13.952709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:14.073781 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:14.085001 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:14.090136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:14.090136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-eb481faf-3f76-4431-8c12-d9d441c7becf tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1340 microversion: 2.20 time: 0.178529 Feb 07 04:15:14.103054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 39/66] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:13 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1340 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:14.162605 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:14.176165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-61bf099a-4e14-4463-8406-2c114ff6576b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.396201 Feb 07 04:15:14.185451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 28/67] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:13 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:14.704357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-61bacb48-8926-44aa-9eba-2adf3fcaf013 req-374247b2-61c3-4691-8f6c-2496e7291854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a", "tag": "e1dbf142-1764-4037-8714-29d34864f234"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:14.706085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:14.706085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:15:14.724096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-61bacb48-8926-44aa-9eba-2adf3fcaf013 req-374247b2-61c3-4691-8f6c-2496e7291854 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:14.726955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-61bacb48-8926-44aa-9eba-2adf3fcaf013 req-374247b2-61c3-4691-8f6c-2496e7291854 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:14.763815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-61bacb48-8926-44aa-9eba-2adf3fcaf013 req-374247b2-61c3-4691-8f6c-2496e7291854 service nova] Creating event network-changed:e1dbf142-1764-4037-8714-29d34864f234 for instance 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a on hv-cinder-79963 Feb 07 04:15:14.779407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-61bacb48-8926-44aa-9eba-2adf3fcaf013 req-374247b2-61c3-4691-8f6c-2496e7291854 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077960 Feb 07 04:15:14.781352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 40/68] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:14.796419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:14.797045 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:14.809087 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:14.809717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:14.810597 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:14.811133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:14.925274 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:14.925895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:14.935215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:14.937867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:14.939711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:14.941038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:15.251406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:15.262993 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-53fa07d1-5bab-488a-8e9b-c68686c84d92 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.469014 Feb 07 04:15:15.264829 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 29/69] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:14 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:15.271518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:15.272565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:15.298419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:15.299112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:15.304560 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:15.307088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:15.578244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:15.593690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ef174346-69e4-4b64-995c-cc2b1ca08c6b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.672334 Feb 07 04:15:15.601410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 41/70] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:14 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:15.640962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:15.641670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:15.679206 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:15.702564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:15.704923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:15.720881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:15.798514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:15.812466 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:15.814701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:15.821985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6550ee09-df90-476e-bbad-6601eb598545 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.555325 Feb 07 04:15:15.823253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 30/71] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:15 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:15.974916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:15.987260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-29105ef6-d920-4103-8ef3-6da4504ac814 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.376526 Feb 07 04:15:15.988769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 42/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:15 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:16.281642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:16.282374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:16.299531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:16.300475 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:16.301513 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:16.302137 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:16.610383 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:16.611589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:16.622669 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:16.623756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:16.634626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:16.635254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:16.864725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:16.881046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9e5ae13d-a35e-4c5d-b81f-66bfdc43f2ec tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.603429 Feb 07 04:15:16.893165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 31/73] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:16 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:16.898348 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:16.899306 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:16.908420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:16.908873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:16.910521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:16.911128 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:16.912637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:16.923315 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e7bdc063-f5d6-4c31-acfd-0c1c2f7dc5d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.316458 Feb 07 04:15:16.925176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 43/74] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:16 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:17.004406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:17.005274 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:17.013523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.018920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:17.019933 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.020735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:17.302412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:17.314300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-286a5176-db33-489e-9a1c-16c48b702291 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.313444 Feb 07 04:15:17.324688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 44/75] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:16 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:17.372159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:17.389383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:17.390898 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:17.392318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6b402711-c084-42ca-a81c-f1ff2299e3c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.498002 Feb 07 04:15:17.393349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 32/76] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:16 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:17.427964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-102d3d6e-41b7-4847-a9ce-8994d1104001 req-a67fbc6e-3ff8-487b-80a4-88c3ddc280ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:17.430225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:17.430225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:15:17.452474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-102d3d6e-41b7-4847-a9ce-8994d1104001 req-a67fbc6e-3ff8-487b-80a4-88c3ddc280ce service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.460523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-102d3d6e-41b7-4847-a9ce-8994d1104001 req-a67fbc6e-3ff8-487b-80a4-88c3ddc280ce service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:17.487176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-102d3d6e-41b7-4847-a9ce-8994d1104001 req-a67fbc6e-3ff8-487b-80a4-88c3ddc280ce service nova] Creating event network-changed:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:15:17.494810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-102d3d6e-41b7-4847-a9ce-8994d1104001 req-a67fbc6e-3ff8-487b-80a4-88c3ddc280ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069030 Feb 07 04:15:17.495934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 45/77] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:17.897763 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:17.898376 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:17.916401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.916401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:17.916401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.916401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:17.942187 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:17.942891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:17.955703 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.964439 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:17.965507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:17.968398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:18.235189 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:18.247037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-525d438d-831f-4ff3-8df5-f16012690233 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.349175 Feb 07 04:15:18.248258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 33/78] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:17 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:18.331879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:18.332776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:18.339197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:18.340527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:18.341552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:18.341914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:18.342727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:18.349849 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f03d99fa-1e15-4d90-927e-9a734dc35c57 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.411275 Feb 07 04:15:18.350016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 46/79] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:17 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:18.410843 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:18.411460 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:18.427599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:18.428029 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:18.429005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:18.429606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:18.791342 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:18.799734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bf7f21ec-dfbd-4e63-9e0f-3e041318a116 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.472359 Feb 07 04:15:18.800375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 34/80] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:18 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:19.000912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:19.015296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:19.019496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:19.021372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0a537213-7adb-4d42-aca7-95910db23e48 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.614819 Feb 07 04:15:19.023706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 47/81] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:18 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:15:19.267038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:19.267960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:19.283047 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.291013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.292115 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.292564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.447367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-205abcd9-8f47-4d0a-a8c1-6e0500af890e req-88a6cc35-43a7-475b-86e1-c7bcd864a3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ab83aa-0797-44a0-b215-5bfdf13708e8", "name": "network-vif-plugged", "status": "completed", "tag": "7316a72a-35b8-43ff-990d-60cf1f6bb7d6"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:19.449885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:19.449885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:19.470352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-205abcd9-8f47-4d0a-a8c1-6e0500af890e req-88a6cc35-43a7-475b-86e1-c7bcd864a3da service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.471460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-205abcd9-8f47-4d0a-a8c1-6e0500af890e req-88a6cc35-43a7-475b-86e1-c7bcd864a3da service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.503105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:19.516774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-eb107830-0acb-4444-a4bb-15e914165df0 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.254950 Feb 07 04:15:19.517357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 48/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:19 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:19.523308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:19.523903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:19.525112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-205abcd9-8f47-4d0a-a8c1-6e0500af890e req-88a6cc35-43a7-475b-86e1-c7bcd864a3da service nova] Creating event network-vif-plugged:7316a72a-35b8-43ff-990d-60cf1f6bb7d6 for instance 31ab83aa-0797-44a0-b215-5bfdf13708e8 on hv-cinder-79963 Feb 07 04:15:19.527352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-205abcd9-8f47-4d0a-a8c1-6e0500af890e req-88a6cc35-43a7-475b-86e1-c7bcd864a3da service nova] Acquired lock "compute-rpcapi-router" {{(pid=116492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 07 04:15:19.528745 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.530581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.533493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.534116 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.543912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.544631 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.545746 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.546327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.552845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.rpcapi [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 07 04:15:19.554339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] Releasing lock "compute-rpcapi-router" {{(pid=116492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 07 04:15:19.576691 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2ceb523a-1fee-4f9a-a7e3-b194825a449c None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345854 Feb 07 04:15:19.577911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 35/83] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:19.775845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:19.798174 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8fabad59-e24d-4519-9739-59959c9a5c86 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.279197 Feb 07 04:15:19.799351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 49/84] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:19 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:19.817782 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:19.818639 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:19.826324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.827042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:19.828166 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:19.828805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:20.040690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:20.041357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:20.050400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:20.051985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:20.052979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:20.056159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:20.250093 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:20.257970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-271ada32-81cd-417a-b456-21030183b6f7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.445357 Feb 07 04:15:20.268628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 36/85] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:19 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:20.372470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:20.385482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:20.392069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:20.393682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e5a73834-6b86-460a-bfcf-89265d87ab25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.357427 Feb 07 04:15:20.405225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 50/86] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:20 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:15:20.535399 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:20.536025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:20.543109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:20.556854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:20.557688 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:20.558059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:20.729471 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:20.743856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f1bc0a95-8b91-4dd0-94b0-5865d99ce478 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.211601 Feb 07 04:15:20.745606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 37/87] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:20 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:20.815749 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:20.816858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:20.822724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:20.823177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:20.823968 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:20.824583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.039138 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:21.048212 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4068a38c-99f9-46c3-9798-c6251678b3f9 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.234771 Feb 07 04:15:21.048212 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 51/88] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:20 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:21.279446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:21.281606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:21.305158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.306771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.312299 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.313486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.414744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:21.415523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:21.425710 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.426697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.428615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.431412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.516385 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:21.527832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9061a3c2-c6bb-408e-9e6e-dc65c9c3f440 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.252260 Feb 07 04:15:21.530168 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 38/89] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:21 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:21.602171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-26e21650-5d77-4332-80bd-e5ff8864934d req-0672b457-a263-41b5-984b-2343be21ba3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79993cf3-effd-4ca7-9f63-a643a924216d", "name": "network-vif-plugged", "status": "completed", "tag": "b5d10650-f8c5-427c-8472-0a665ca4301f"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:21.605477 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:21.605477 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:21.613413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-26e21650-5d77-4332-80bd-e5ff8864934d req-0672b457-a263-41b5-984b-2343be21ba3b service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.613785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-26e21650-5d77-4332-80bd-e5ff8864934d req-0672b457-a263-41b5-984b-2343be21ba3b service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.621202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:21.625501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-26e21650-5d77-4332-80bd-e5ff8864934d req-0672b457-a263-41b5-984b-2343be21ba3b service nova] Creating event network-vif-plugged:b5d10650-f8c5-427c-8472-0a665ca4301f for instance 79993cf3-effd-4ca7-9f63-a643a924216d on hv-cinder-79963 Feb 07 04:15:21.630857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-26e21650-5d77-4332-80bd-e5ff8864934d req-0672b457-a263-41b5-984b-2343be21ba3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036582 Feb 07 04:15:21.632624 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:21.636387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 39/90] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:21.638275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:21.639658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f8d0d0c1-e443-4dea-855d-9950a7fcae24 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.229671 Feb 07 04:15:21.640604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 52/91] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:21 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:15:21.762517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:21.763230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:21.771398 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.772830 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.775128 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:21.775839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:21.993526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:22.000945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5da638c1-a491-47ec-97dd-1f59ddd1c28b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.242838 Feb 07 04:15:22.001515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 40/92] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:21 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:22.062480 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:22.063095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:22.068983 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:22.069642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:22.070599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:22.071247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:22.216395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:22.226603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ed05bc33-98f4-4fb2-9a73-32b8d22a709e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.165573 Feb 07 04:15:22.226603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 53/93] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:22 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:22.546897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:22.547528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:22.554710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:22.555171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:22.556030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:22.556491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:22.659009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:22.659783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:22.670212 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:22.670778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:22.673654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:22.674355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:22.829524 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:22.839806 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bc67be33-2331-41f2-9535-f73ee729441f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1318 microversion: 2.1 time: 0.296830 Feb 07 04:15:22.841486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 41/94] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:22 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:22.914753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:22.926242 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:22.927381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:22.928495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3070faf7-7a5b-47bc-8cd4-16c6a4c1e179 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.273633 Feb 07 04:15:22.929707 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 54/95] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:22 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:23.018325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:23.018934 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:23.024728 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.025362 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.026322 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.026937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.170900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:23.178334 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-281d0805-4dff-4ad9-b06d-7045307c6161 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1315 microversion: 2.1 time: 0.163779 Feb 07 04:15:23.179107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 42/96] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:23 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:23.241830 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:23.243447 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:23.255442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.256555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.257415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.257867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.541977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:23.552615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6167c342-b40c-4a70-80d2-f747416d72b0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.315573 Feb 07 04:15:23.554515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 55/97] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:23 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:23.652037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-65fea721-7410-4fa4-80f2-aba2ee2f9e66 req-dfc949a6-04d5-420b-b4d8-4d46b95cf892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb55652-6b90-48a0-8c34-def2934ea25d", "name": "network-vif-plugged", "status": "completed", "tag": "08a3936d-26aa-4031-920c-7291ded7d6bc"}, {"server_uuid": "9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a", "name": "network-vif-plugged", "status": "completed", "tag": "e1dbf142-1764-4037-8714-29d34864f234"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:23.653902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:23.653902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:23.670152 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-65fea721-7410-4fa4-80f2-aba2ee2f9e66 req-dfc949a6-04d5-420b-b4d8-4d46b95cf892 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.670602 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-65fea721-7410-4fa4-80f2-aba2ee2f9e66 req-dfc949a6-04d5-420b-b4d8-4d46b95cf892 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.688651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-65fea721-7410-4fa4-80f2-aba2ee2f9e66 req-dfc949a6-04d5-420b-b4d8-4d46b95cf892 service nova] Creating event network-vif-plugged:08a3936d-26aa-4031-920c-7291ded7d6bc for instance 8bb55652-6b90-48a0-8c34-def2934ea25d on hv-cinder-79963 Feb 07 04:15:23.689158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-65fea721-7410-4fa4-80f2-aba2ee2f9e66 req-dfc949a6-04d5-420b-b4d8-4d46b95cf892 service nova] Creating event network-vif-plugged:e1dbf142-1764-4037-8714-29d34864f234 for instance 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a on hv-cinder-79963 Feb 07 04:15:23.696909 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-65fea721-7410-4fa4-80f2-aba2ee2f9e66 req-dfc949a6-04d5-420b-b4d8-4d46b95cf892 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050557 Feb 07 04:15:23.697600 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 43/98] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:15:23.858098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:23.859507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:23.868106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.869222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.870524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.871352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.949069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:23.951107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:23.990834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.991312 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:23.998049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:23.998629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:24.058975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:24.069765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1617453e-c315-4984-ab49-2b9ab5b0846d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1509 microversion: 2.1 time: 0.215376 Feb 07 04:15:24.071667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 56/99] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:23 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:24.199629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:24.200966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:24.216648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:24.218399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:24.221931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:24.223843 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:24.323482 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:24.331719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:24.334265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:24.335642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-927f5337-3950-4eb8-a860-ce6f08455ac0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.392006 Feb 07 04:15:24.338018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 44/100] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:23 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:24.467417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:24.476556 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9fb36116-ca89-4499-8feb-80d3b82c9b7b tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1503 microversion: 2.1 time: 0.283540 Feb 07 04:15:24.477149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 57/101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:24 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:24.570759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:24.571664 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:24.579675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:24.580160 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:24.580963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:24.584823 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:25.077943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:25.097068 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-15934be7-cc76-4629-9e58-624d91d7cb31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.529765 Feb 07 04:15:25.109786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 45/102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:24 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:25.355121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:25.355679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:25.363914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:25.364789 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:25.371785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:25.372511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:25.615039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c3403d-20dd-4ae7-968e-13328fff62fb"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:25.616519 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:25.626826 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:25.638500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:25.642861 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:25.643483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:25.644158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:25.646229 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:25.647246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:25.647455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-02c864c3-97b9-42b2-982e-d5e47f8debd6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.294729 Feb 07 04:15:25.661415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 58/103] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:25 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:26.011648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a697d6-b107-4e91-90dd-73918986b115"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:26.013262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:26.019930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.020649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.021915 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.022681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.146836 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c6f16fc1-3943-49ee-a51c-e9b89e8ab9c8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537169 Feb 07 04:15:26.147650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 46/104] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:15:25 2022] POST /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:26.153253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:26.153948 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:26.162777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.163691 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.165612 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.166202 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.375403 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:26.385753 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0bdf41a0-4a7d-486b-bcbb-1a6ba6c9f407 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1322 microversion: 2.1 time: 0.236230 Feb 07 04:15:26.386442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 47/105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:26 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:26.515129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-a55bbb0c-e3f1-4a39-ab81-8e7623ee8d14 req-f21c2735-b6e3-4124-9cb7-8917c9c99e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "name": "network-vif-plugged", "status": "completed", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:26.524369 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:26.524369 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:26.538326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-a55bbb0c-e3f1-4a39-ab81-8e7623ee8d14 req-f21c2735-b6e3-4124-9cb7-8917c9c99e7f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.540314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-a55bbb0c-e3f1-4a39-ab81-8e7623ee8d14 req-f21c2735-b6e3-4124-9cb7-8917c9c99e7f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.571283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-a55bbb0c-e3f1-4a39-ab81-8e7623ee8d14 req-f21c2735-b6e3-4124-9cb7-8917c9c99e7f service nova] Creating event network-vif-plugged:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:15:26.600104 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-a55bbb0c-e3f1-4a39-ab81-8e7623ee8d14 req-f21c2735-b6e3-4124-9cb7-8917c9c99e7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087874 Feb 07 04:15:26.600104 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 48/106] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:26.650687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ba6d2d43-16f9-4d64-8428-85cf68858b6a tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "POST /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640841 Feb 07 04:15:26.652166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 59/107] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:15:26 2022] POST /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:26.666421 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:26.667129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:26.678281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.678763 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.679563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:26.680025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:26.922701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:26.932153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:26.935294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:26.937352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-00496133-aacf-4c7b-bdcb-cae6f9f15525 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.275542 Feb 07 04:15:26.949632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 49/108] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:26 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:27.405900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:27.406676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:27.413420 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:27.414106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:27.415284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:27.415921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:27.813496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:27.826815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4d15a822-9672-4181-be6b-976578ef5b7d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1515 microversion: 2.1 time: 0.425911 Feb 07 04:15:27.827983 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 60/109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:27 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1515 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:27.851230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:27.853743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:27.864330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:27.864330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:27.865106 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:27.865722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:27.891671 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lazy-loading 'flavor' on Instance uuid 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:15:27.959722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:27.960600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:27.968341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:27.971354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:27.973946 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:27.975635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:28.178914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:28.187630 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:28.189547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:28.190690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f67a807e-690c-4058-a09a-e39ae698ceae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1407 microversion: 2.20 time: 0.237567 Feb 07 04:15:28.193329 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 61/110] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:27 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:28.199423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1036e7c6-9003-47ed-abe0-2e803bcb0711 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a/action" status: 200 len: 32 microversion: 2.1 time: 0.354958 Feb 07 04:15:28.208354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 50/111] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:15:27 2022] POST /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 07 04:15:28.219408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:28.220239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:28.226502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:28.227170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:28.228174 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:28.228623 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:28.436627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:28.453896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1a9bf24e-b2ec-45b3-a34a-4531282f4586 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.239106 Feb 07 04:15:28.456961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 62/112] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:28 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:29.209874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:29.210564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:29.217020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:29.217673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:29.218644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:29.219243 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:29.393954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:29.402857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:29.405026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:29.406271 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a0a9c560-75a2-4449-b604-2db3d79e6b36 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1600 microversion: 2.20 time: 0.200907 Feb 07 04:15:29.406985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 51/113] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:29 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1600 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:29.425067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:29.426262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:29.435254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:29.435982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:29.437138 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:29.437938 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:29.474893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:29.476380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:29.490319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:29.490319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:29.494288 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:29.495509 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:29.546549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9a40b784-2ceb-478b-9c2c-5fc5faff4ce3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125648 Feb 07 04:15:29.547136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 63/114] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Feb 7 04:15:29 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:15:29.802745 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:29.813356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-55bd59b6-46ed-4fd2-ba7c-f219c5325289 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.342397 Feb 07 04:15:29.813947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 52/115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:29 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:30.832564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:30.833172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:30.842944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:30.844957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:30.847674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:30.848333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:31.398534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:31.407264 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5ef3c585-b341-46e2-ad5a-eaa1751d3d63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.579452 Feb 07 04:15:31.408360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 64/116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:30 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:31.483437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:31.484269 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:31.485871 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-463e14d0-49af-4e58-b5bd-25a317644dbf req-ba2605de-9303-45c9-81fe-289e854b6261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:31.487649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:31.487649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:15:31.491968 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:31.492743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:31.493784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:31.494424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:31.496571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-463e14d0-49af-4e58-b5bd-25a317644dbf req-ba2605de-9303-45c9-81fe-289e854b6261 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:31.497015 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-463e14d0-49af-4e58-b5bd-25a317644dbf req-ba2605de-9303-45c9-81fe-289e854b6261 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:31.515215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-463e14d0-49af-4e58-b5bd-25a317644dbf req-ba2605de-9303-45c9-81fe-289e854b6261 service nova] Creating event network-changed:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:15:31.521778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-463e14d0-49af-4e58-b5bd-25a317644dbf req-ba2605de-9303-45c9-81fe-289e854b6261 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038742 Feb 07 04:15:31.522923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 65/117] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:31.725698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:31.734770 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:31.737396 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:31.739416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4b9ff5ed-7cb2-46d3-970f-5063d079556d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1600 microversion: 2.20 time: 0.259838 Feb 07 04:15:31.740737 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 53/118] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:31 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1600 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:32.425412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:32.427946 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:32.442728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:32.443483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:32.445199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:32.446926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:32.767660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:32.773304 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:32.804508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:32.806581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:32.810303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:32.812881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:32.877305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:32.886888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b5615147-e64a-4a88-b388-bf9ca28daf72 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.465901 Feb 07 04:15:32.892208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 66/119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:32 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:33.040777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:33.051495 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:33.055591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:33.056858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fb47c4aa-22fb-46aa-8f45-b1667f20d96c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1719 microversion: 2.20 time: 0.300880 Feb 07 04:15:33.058846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 54/120] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:15:32 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1719 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:15:33.075926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:33.076470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:33.083469 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:33.083936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:33.084778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:33.085217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:33.109550 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4a3ae987-d525-4d23-a499-fa4cafe43dab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/ips" status: 200 len: 153 microversion: 2.20 time: 0.038403 Feb 07 04:15:33.111694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 67/121] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Feb 7 04:15:33 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:15:33.903328 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:33.903944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:33.910850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:33.911425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:33.912267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:33.912711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:34.050707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:34.058351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-acab4432-dfee-4aab-a37c-e348eaeabd28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.158741 Feb 07 04:15:34.058919 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 55/122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:33 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:35.075333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:35.075951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:35.082309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:35.082761 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:35.083573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:35.084013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:35.217529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:35.224788 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c6dcf7e6-3e17-4410-85ad-ead051103c8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.153766 Feb 07 04:15:35.225369 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 68/123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:35 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:36.241032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:36.241637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:36.247777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:36.248270 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:36.249044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:36.249471 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:36.387049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:36.394910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-99111240-5fd2-4824-add7-56f742ab7808 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.157464 Feb 07 04:15:36.395463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 56/124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:36 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:37.411642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:37.412213 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:37.419154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:37.419604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:37.420412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:37.420851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:37.549816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:37.557727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-83ebf8d1-571e-4f3f-9e7f-40fa30c53d08 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.149795 Feb 07 04:15:37.558295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 69/125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:37 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:38.574614 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:38.575213 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:38.581537 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:38.581986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:38.582759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:38.583244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:38.726692 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:38.734937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0e589c83-d80b-47c3-b230-8718548709a7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.164504 Feb 07 04:15:38.735709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 57/126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:38 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:39.750261 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:39.752477 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:39.758516 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:39.758970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:39.759758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:39.760247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:39.892296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:39.899968 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-87275468-a8f1-4630-abef-3d93f006b838 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.153264 Feb 07 04:15:39.900559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 70/127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:39 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:40.916605 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:40.917755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:40.924085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:40.924547 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:40.925341 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:40.925786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:41.061286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:41.069029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5728640e-7403-4b09-b400-eab1b94fa43a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.156260 Feb 07 04:15:41.069814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 58/128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:40 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:42.086362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:42.087067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:42.093604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:42.094144 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:42.095340 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:42.095778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:42.230956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:42.238287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-217ca4fe-f7c6-44cf-8191-9742637f083e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.155919 Feb 07 04:15:42.238850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 71/129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:42 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:42.459551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1107040250", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "7ca219ba-88c9-4d7f-a70f-fc6411c07502"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:42.509287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] validate_networks() for [('7ca219ba-88c9-4d7f-a70f-fc6411c07502', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:15:42.876162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:15:42.876579 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:15:42.877047 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:15:42.877446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:15:42.877881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:15:42.886888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:42.887333 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:42.888218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:42.888651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:42.906451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:15:42.910834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for user 4d4bef2b813144fab2053b3547694bbe and project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:15:42.922057 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:15:42.924539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:15:42.976114 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-930880b7-d369-4e3e-bcdb-fc00ef792289 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520110 Feb 07 04:15:42.981428 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 59/130] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:15:42.986836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5b85e9bf-f0f3-4419-b1b4-2810921b5838 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:42.987601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5b85e9bf-f0f3-4419-b1b4-2810921b5838 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:43.039663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5b85e9bf-f0f3-4419-b1b4-2810921b5838 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:43.048981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5b85e9bf-f0f3-4419-b1b4-2810921b5838 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1218 microversion: 2.1 time: 0.064462 Feb 07 04:15:43.049958 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 72/131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:42 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:43.259558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:43.260476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:43.266846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:43.268335 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:43.269248 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:43.269787 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:43.430815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:43.439330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-da36773b-a566-45c5-8ff2-c389d15e022d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.185322 Feb 07 04:15:43.440798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 60/132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:43 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:44.066594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:44.067385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:44.074056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:44.074254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:44.075196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:44.075785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:44.154180 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:44.162825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e9eee20f-31cc-404a-80ea-b620a550c515 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1270 microversion: 2.1 time: 0.100168 Feb 07 04:15:44.163665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 73/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:44 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:44.457575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:44.458256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:44.475715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:44.476212 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:44.477801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:44.478508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:44.860567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:44.869722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6a9d54e9-90c0-4e72-b5ad-c629683b566d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.415699 Feb 07 04:15:44.870331 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 61/134] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:44 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:45.180784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:45.181397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:45.194059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:45.196111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:45.198403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:45.199027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:45.328589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:45.337580 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1e64d6bc-f404-4530-afca-79383edfe699 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1276 microversion: 2.1 time: 0.160249 Feb 07 04:15:45.339110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 74/135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:45 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:45.889541 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:45.890834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:45.900954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:45.915240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:45.917636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:45.918570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:46.342722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:46.355010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:46.355634 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:46.367995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8e85e866-4d86-4477-960c-35019c69f083 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.467705 Feb 07 04:15:46.368723 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 62/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:45 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:46.372199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:46.372199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:46.372199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:46.372199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:46.581514 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:46.590904 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8f6fcc10-0c77-42a0-b8bc-ef6f98d5756d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.239203 Feb 07 04:15:46.592400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 75/137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:46 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:46.855991 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-00767a16-bab6-4230-be00-92006d3f7ab7 req-4ca6a6c9-2b18-49dd-9ff1-9b4297aab810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c530ca-8978-4f69-b360-974e35d97a0c", "tag": "e4368539-c55d-4781-9c7f-7915272fcb88"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:46.858552 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:46.858552 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:46.872028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-00767a16-bab6-4230-be00-92006d3f7ab7 req-4ca6a6c9-2b18-49dd-9ff1-9b4297aab810 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:46.872740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-00767a16-bab6-4230-be00-92006d3f7ab7 req-4ca6a6c9-2b18-49dd-9ff1-9b4297aab810 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:46.888712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-00767a16-bab6-4230-be00-92006d3f7ab7 req-4ca6a6c9-2b18-49dd-9ff1-9b4297aab810 service nova] Creating event network-changed:e4368539-c55d-4781-9c7f-7915272fcb88 for instance b7c530ca-8978-4f69-b360-974e35d97a0c on hv-cinder-79963 Feb 07 04:15:46.894544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-00767a16-bab6-4230-be00-92006d3f7ab7 req-4ca6a6c9-2b18-49dd-9ff1-9b4297aab810 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044065 Feb 07 04:15:46.895445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 63/138] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:47.385263 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:47.386043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:47.394001 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:47.395354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:47.396808 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:47.397254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:47.608672 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:47.609284 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:47.623223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:47.623850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:47.625776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:47.628765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:47.730748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:47.738487 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ffd44aa5-4b14-41d0-8b30-e856856df530 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.357212 Feb 07 04:15:47.739066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 76/139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:47 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:48.010054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:48.019481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f63fafb0-04e0-4997-9bf7-5daafa249bf5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.415153 Feb 07 04:15:48.020151 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 64/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:47 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:48.757529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:48.759284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:48.772871 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:48.774841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:48.776867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:48.778118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:49.036013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:49.040853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:49.054639 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:49.055728 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:49.057386 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:49.058059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:49.344129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:49.386686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a4222727-89a0-4641-8543-a8be9101d140 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.353566 Feb 07 04:15:49.387287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 65/141] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:49 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:49.434531 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:49.445095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f3d0907d-b1b4-42d8-b545-68dab221058d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.690306 Feb 07 04:15:49.447195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 77/142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:48 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:50.407318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:50.409755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:50.421417 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:50.422453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:50.423684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:50.425187 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:50.479169 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:50.481754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:50.494555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:50.497194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:50.498680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:50.512713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:50.977221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:50.988639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8f5dc261-f542-478e-bc2c-4480860f3da8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.516118 Feb 07 04:15:50.998326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:51.000776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 78/143] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:50 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:51.009702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:51.010605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:51.020031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2978c9d3-efaa-4750-8fc1-033ad2a0cea4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.620347 Feb 07 04:15:51.022808 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:51.023248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:51.026214 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:51.027180 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:51.032225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 66/144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:50 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:51.081738 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:15:51.249176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-dd226abe-5b1a-4fba-b15c-9f416d51d234 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 204 len: 0 microversion: 2.1 time: 0.246209 Feb 07 04:15:51.251504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 79/145] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:15:51 2022] DELETE /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:15:51.262330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:51.263080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:51.272639 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:51.274309 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:51.276727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:51.277498 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:51.620491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:51.640818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c2eb3fa4-7385-4e14-b6cc-c739e913fb10 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1555 microversion: 2.1 time: 0.383362 Feb 07 04:15:51.644866 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 67/146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:51 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1555 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:52.006769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:52.008846 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:52.016791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:52.017493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:52.018771 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:52.020335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:52.042801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:52.043683 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:52.058002 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:52.058471 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:52.059274 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:52.061126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:52.487005 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:52.502704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d76b9fbb-a163-41cd-98a6-e3fba9bb8751 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.463635 Feb 07 04:15:52.503303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 68/147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:52 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:52.566171 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:52.577526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9762e352-e4f1-4cff-9e3c-144226f59e78 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.575117 Feb 07 04:15:52.578116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 80/148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:52 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:52.663500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:52.665206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:52.682165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:52.682634 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:52.683454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:52.683901 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:53.381147 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:53.401825 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-32a80dc3-4cd8-4091-89a9-a37c6b526837 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1555 microversion: 2.1 time: 0.739764 Feb 07 04:15:53.403856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 69/149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:52 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1555 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:53.524515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:53.525816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:53.546192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:53.548571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:53.553436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:53.556389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:53.597893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:53.598914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:53.611253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:53.616720 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:53.620906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:53.622792 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:54.149391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:54.158046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f015d8b7-7a2e-4ac8-8698-f1d3d643110b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.567483 Feb 07 04:15:54.167528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 70/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:53 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:54.192655 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:54.211124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-30db4e0c-7352-41f0-961d-7783ca7be920 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.692066 Feb 07 04:15:54.217038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 81/151] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:53 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:54.420903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:54.421635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:54.428677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:54.429130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:54.437702 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:54.439628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:54.723333 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:54.734105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9c33a74f-319b-44a2-9013-639d8bf86e72 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1555 microversion: 2.1 time: 0.316667 Feb 07 04:15:54.750509 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 71/152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:54 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:55.182030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:55.182771 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:55.203961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:55.207932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:55.212385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:55.213140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:55.231770 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:55.232589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:55.247469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:55.248882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:55.256032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:55.262768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:55.802907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:55.829569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-44bbf0ed-a32e-467b-a445-bd666cb19987 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.602008 Feb 07 04:15:55.833335 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 72/153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:55 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:55.841868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-1b240118-5848-4fdf-a249-f59f55adc38e req-221aeeb4-241f-4bfc-9723-791cd1fc95c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79993cf3-effd-4ca7-9f63-a643a924216d", "name": "network-vif-deleted", "tag": "b5d10650-f8c5-427c-8472-0a665ca4301f"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:55.847456 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:55.847456 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:55.881333 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-1b240118-5848-4fdf-a249-f59f55adc38e req-221aeeb4-241f-4bfc-9723-791cd1fc95c2 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:55.882122 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-1b240118-5848-4fdf-a249-f59f55adc38e req-221aeeb4-241f-4bfc-9723-791cd1fc95c2 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:55.895316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:55.933862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-64306b11-5533-437d-922b-670f6362afbf tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.754153 Feb 07 04:15:55.938373 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 82/154] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:55 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:55.980371 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-1b240118-5848-4fdf-a249-f59f55adc38e req-221aeeb4-241f-4bfc-9723-791cd1fc95c2 service nova] Creating event network-vif-deleted:b5d10650-f8c5-427c-8472-0a665ca4301f for instance 79993cf3-effd-4ca7-9f63-a643a924216d on hv-cinder-79963 Feb 07 04:15:55.983148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:55.987708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:56.001469 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:56.002667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:56.004795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:56.005364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-1b240118-5848-4fdf-a249-f59f55adc38e req-221aeeb4-241f-4bfc-9723-791cd1fc95c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168954 Feb 07 04:15:56.006794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:56.010769 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 73/155] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:15:56.138972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:56.179657 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-332c2aab-317a-4ae0-bfda-242c700baca2 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1346 microversion: 2.1 time: 0.237719 Feb 07 04:15:56.185296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 83/156] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:55 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:56.850190 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:56.850998 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:56.864497 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:56.865117 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:56.868876 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:56.869413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:56.965768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:56.966681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:56.979211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:56.980533 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:56.983569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:56.984176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:57.153155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:57.165734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3671b306-6ed9-40c9-b9c8-215b4cdca395 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.320315 Feb 07 04:15:57.176584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 74/157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:56 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:57.201181 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:57.201862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:57.210515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:57.211279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:57.212959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:57.213654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:57.265199 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:57.266000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:57.266983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lazy-loading 'fault' on Instance uuid 79993cf3-effd-4ca7-9f63-a643a924216d {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:15:57.340818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72c1b5afcb048559a9602b9a2ed9ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015f07f102774e9f9465bcf4e71744f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:57.353297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7da0f2bb-7f25-495d-82b3-96b344cda278 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 200 len: 1351 microversion: 2.1 time: 0.159184 Feb 07 04:15:57.363244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 75/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:57 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:15:57.771637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-cc915a07-5113-46a9-bec6-18ad88eac05f req-0daf8751-1911-4a41-94a3-93801bd976cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c530ca-8978-4f69-b360-974e35d97a0c", "name": "network-vif-plugged", "status": "completed", "tag": "e4368539-c55d-4781-9c7f-7915272fcb88"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:15:57.774234 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:15:57.774234 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:15:57.793422 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-cc915a07-5113-46a9-bec6-18ad88eac05f req-0daf8751-1911-4a41-94a3-93801bd976cf service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:57.796681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-cc915a07-5113-46a9-bec6-18ad88eac05f req-0daf8751-1911-4a41-94a3-93801bd976cf service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:57.831472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-cc915a07-5113-46a9-bec6-18ad88eac05f req-0daf8751-1911-4a41-94a3-93801bd976cf service nova] Creating event network-vif-plugged:e4368539-c55d-4781-9c7f-7915272fcb88 for instance b7c530ca-8978-4f69-b360-974e35d97a0c on hv-cinder-79963 Feb 07 04:15:57.847164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:57.857222 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-cc915a07-5113-46a9-bec6-18ad88eac05f req-0daf8751-1911-4a41-94a3-93801bd976cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093545 Feb 07 04:15:57.861573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-156892ce-dddc-4d9d-9f9a-c9e5e376ee81 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.901384 Feb 07 04:15:57.861884 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 76/159] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:15:57.864886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 84/160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:56 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:58.187071 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:58.188199 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:58.220289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.225096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.230214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.236253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.372484 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:58.373360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:58.383349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.387620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.388867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.392457 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.444365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] HTTP exception thrown: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. Feb 07 04:15:58.445627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Returning 404 to user: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:15:58.446526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-60bb47c0-03ec-474f-9b81-64a3ce32b5f1 tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 404 len: 111 microversion: 2.1 time: 0.079487 Feb 07 04:15:58.452589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 85/161] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:58 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:15:58.729972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:58.730947 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:58.745786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.747143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.748112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.748612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.809921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] HTTP exception thrown: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. Feb 07 04:15:58.810526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Returning 404 to user: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:15:58.818222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ca445661-b3d1-4710-8e9c-82f236378f4c tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092550 Feb 07 04:15:58.822101 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 86/162] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:15:58 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:15:58.878877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:15:58.879505 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:15:58.886225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.886225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:58.909827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:15:58.910542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:15:59.066765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:59.075322 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a362679f-e388-4fe1-8bd6-c7b61dc0ea97 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.896220 Feb 07 04:15:59.081049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 77/163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:58 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:15:59.422701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:15:59.449682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ad650269-fd99-45ee-8b44-d4fb3fb82323 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1521 microversion: 2.1 time: 0.574677 Feb 07 04:15:59.452178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 87/164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:15:58 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:00.098942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:00.099551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:00.107522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:00.111616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:00.115074 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:00.121473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:00.468750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:00.469954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:00.491499 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:00.492432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:00.493467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:00.494049 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:00.740920 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:00.753252 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8020c78c-1970-4ab0-aca0-ea19b5bff1a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1318 microversion: 2.1 time: 0.657838 Feb 07 04:16:00.767432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 78/165] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:00 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:00.907090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:00.925897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1071aeb2-288b-46fd-b108-27ed87cab69f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1501 microversion: 2.1 time: 0.453519 Feb 07 04:16:00.927013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 88/166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:00 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1501 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:00.948521 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:00.949562 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:00.967307 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:00.968619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:00.972674 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:00.973126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:01.407421 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:01.419852 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a8977d2c-8e28-42a6-a551-dca28649743c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1514 microversion: 2.1 time: 0.479490 Feb 07 04:16:01.421908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 79/167] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:00 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1514 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:01.780224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:01.786306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:01.810670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:01.811165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:01.814423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:01.814888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.426842 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:02.427345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:02.433927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.434441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.435171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.441982 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.462972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] HTTP exception thrown: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. Feb 07 04:16:02.463947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Returning 404 to user: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:16:02.465385 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0ac3941f-e4c5-45e2-8d29-788640ca629e tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "DELETE /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 404 len: 111 microversion: 2.1 time: 0.042737 Feb 07 04:16:02.465935 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 80/168] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:16:02 2022] DELETE /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:16:02.476132 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:02.477550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] [instance: 79993cf3-effd-4ca7-9f63-a643a924216d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:02.485022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.485778 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.486749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.488542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.523438 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] HTTP exception thrown: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. Feb 07 04:16:02.526914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] Returning 404 to user: Instance 79993cf3-effd-4ca7-9f63-a643a924216d could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:16:02.530910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-218bd958-2663-4e23-80d0-15ec283705fd tempest-DeleteServersTestJSON-1280125846 tempest-DeleteServersTestJSON-1280125846-project] 10.222.0.13 "GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d" status: 404 len: 111 microversion: 2.1 time: 0.057462 Feb 07 04:16:02.535580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 81/169] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:02 2022] GET /compute/v2.1/servers/79993cf3-effd-4ca7-9f63-a643a924216d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:16:02.553786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:02.565864 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d8e4c4d6-1e24-4d9f-b9d6-d1428431a2d5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1508 microversion: 2.1 time: 0.793397 Feb 07 04:16:02.581288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 89/170] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:01 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1508 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:02.597486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c3403d-20dd-4ae7-968e-13328fff62fb"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:02.602339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:02.609561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.610788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.612907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.613563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.774465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] HTTP exception thrown: Invalid volume: volume d1c3403d-20dd-4ae7-968e-13328fff62fb is already attached to instances: 31ab83aa-0797-44a0-b215-5bfdf13708e8 Feb 07 04:16:02.775068 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Returning 400 to user: Invalid volume: volume d1c3403d-20dd-4ae7-968e-13328fff62fb is already attached to instances: 31ab83aa-0797-44a0-b215-5bfdf13708e8 {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:16:02.775905 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bd520b27-3dbe-4d03-a680-9f35bea489fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.186229 Feb 07 04:16:02.777200 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 82/171] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:16:02 2022] POST /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:16:02.871682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:02.873052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:02.881094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.881857 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:02.884939 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:02.885715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.088381 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:03.089861 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:03.098718 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:03.099431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.100776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:03.102130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.150710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lazy-loading 'flavor' on Instance uuid 8bb55652-6b90-48a0-8c34-def2934ea25d {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:16:03.155057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lazy-loading 'services' on Instance uuid 31ab83aa-0797-44a0-b215-5bfdf13708e8 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:16:03.275937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f6f0cbbe-6178-4c9f-b6e1-a9675b04e626 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action" status: 200 len: 32 microversion: 2.1 time: 0.191136 Feb 07 04:16:03.281318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 83/172] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:16:03 2022] POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:16:03.286890 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:03.288910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:03.299793 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:03.300292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.308206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:03.308671 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.382163 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-761fefbd-05d0-4a34-8e46-4e3e5179b93d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments/d1c3403d-20dd-4ae7-968e-13328fff62fb" status: 202 len: 0 microversion: 2.1 time: 0.515984 Feb 07 04:16:03.390552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 90/173] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:16:02 2022] DELETE /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments/d1c3403d-20dd-4ae7-968e-13328fff62fb => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:16:03.404667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:03.406631 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:03.424206 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:03.424674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.425455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:03.426072 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:03.564814 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-94c1798d-bf71-47c6-8e3c-f96da4290e79 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172423 Feb 07 04:16:03.565440 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 91/174] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:16:03 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:16:04.502881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:04.513352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c48a7712-8c14-4503-9f6f-5488f36e6a31 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 1.230582 Feb 07 04:16:04.516361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 84/175] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:03 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:04.577282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:04.578849 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:04.592945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:04.593381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:04.597417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:04.598104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:04.681974 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f1849dd1-8be6-42cf-85bb-2cafab3ab091 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107722 Feb 07 04:16:04.683956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 92/176] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:16:04 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:16:05.530187 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:05.530813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:05.540557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:05.541003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:05.541803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:05.542249 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:05.697732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:05.699275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:05.712577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:05.713315 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:05.714463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:05.715509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:05.841502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a996b95c-886c-4e48-8d9f-ce6d4bbacf1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150649 Feb 07 04:16:05.856251 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 93/177] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:16:05 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:16:05.897094 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:05.906499 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5401f803-cee8-42ad-af5f-ce04bc27090a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.380136 Feb 07 04:16:05.907085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 85/178] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:05 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:06.250422 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-763495213", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "7ca219ba-88c9-4d7f-a70f-fc6411c07502"}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:06.379942 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] validate_networks() for [('7ca219ba-88c9-4d7f-a70f-fc6411c07502', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:16:06.925707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:06.927203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:06.950630 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:06.951311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:06.957572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:06.958215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:07.621301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:07.632228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-94abce07-e8ed-4414-961d-e24323f3eba6 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.712473 Feb 07 04:16:07.635712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 86/179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:06 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:07.951995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:16:07.953012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:16:07.953751 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:16:07.954399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:16:07.955340 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:16:07.994785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:07.995232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:07.996063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:07.996510 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:08.037850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:08.047184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for user 4d4bef2b813144fab2053b3547694bbe and project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:08.081812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:16:08.092244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:16:08.238469 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7b890448-4e15-4c0c-b56e-63adf144f4fc tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992083 Feb 07 04:16:08.247994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 94/180] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:16:08.250097 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a22aff25-c704-44bf-8b4b-ec0e0d4071d8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:08.250937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a22aff25-c704-44bf-8b4b-ec0e0d4071d8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:08.537411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a22aff25-c704-44bf-8b4b-ec0e0d4071d8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:08.551095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a22aff25-c704-44bf-8b4b-ec0e0d4071d8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1217 microversion: 2.1 time: 0.304990 Feb 07 04:16:08.564070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 87/181] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:08 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:08.651163 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:08.652023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:08.681287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:08.681647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:08.682491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:08.691247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:09.411182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:09.434990 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6485f8f3-4bdd-4d4b-a1e9-fe52be22f3b1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.787951 Feb 07 04:16:09.436221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 95/182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:08 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:09.569546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:09.570366 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:09.583353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:09.584265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:09.585980 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:09.586661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:09.678817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:09.694078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a00fdd74-1bc4-4097-b806-15c2d8ec6d61 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1221 microversion: 2.1 time: 0.128619 Feb 07 04:16:09.699193 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 88/183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:09 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:10.451852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:10.453231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:10.463275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:10.464258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:10.481497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:10.485529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:10.715945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:10.716629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:10.725015 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:10.725400 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:10.729363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:10.731280 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:10.825140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:10.835851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1cafbf2a-1ae3-424e-8e67-a79e12414162 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.387034 Feb 07 04:16:10.838909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 96/184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:10 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:10.905899 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:10.917025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-14d80155-c1c9-4f3c-a619-dc081905f3c7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1213 microversion: 2.1 time: 0.206319 Feb 07 04:16:10.932305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 89/185] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:10 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1213 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:11.862811 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:11.863485 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:11.874754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:11.875360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:11.876175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:11.876804 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:11.936292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:11.937006 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:11.945613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:11.956695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:11.957766 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:11.961675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:12.183310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:12.194029 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4464fe39-6f96-4879-8f37-d4d840c75305 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.337480 Feb 07 04:16:12.197814 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 97/186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:11 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:12.290758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:12.300282 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e74e51f3-dcf3-4c7d-b481-f7967850eee0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1275 microversion: 2.1 time: 0.367545 Feb 07 04:16:12.303308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 90/187] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:11 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:13.219227 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:13.220569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:13.250930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:13.255513 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:13.256701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:13.257366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:13.320713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:13.321394 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:13.335896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:13.342658 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:13.343524 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:13.352451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:13.590835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:13.608313 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8fe56163-25a8-4d76-b9c8-792879caf092 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1275 microversion: 2.1 time: 0.291438 Feb 07 04:16:13.617324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 91/188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:13 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:13.645063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:13.664681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a8d21b4c-4d77-4237-a33a-85cebea21ada tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.449221 Feb 07 04:16:13.678706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 98/189] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:13 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:14.502084 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-86e19854-862a-43e5-b665-e6b4b56e0f08 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Action: 'create', calling method: .version_select at 0x7f917bd76670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1983533653"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:14.571238 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-86e19854-862a-43e5-b665-e6b4b56e0f08 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:14.581834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-86e19854-862a-43e5-b665-e6b4b56e0f08 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for user 5af228b237eb4e93baf30ade75bdca98 and project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:14.626430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:14.628193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:14.645137 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:14.654616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:14.655552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:14.660224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:14.882993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:14.901292 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d7a3fb7d-4e79-479b-82a3-ad4faba73f47 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1275 microversion: 2.1 time: 0.273330 Feb 07 04:16:14.911609 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 99/190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:14 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:14.936463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:14.937127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:14.965807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:14.966304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:14.967114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:14.978323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:15.319032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-86e19854-862a-43e5-b665-e6b4b56e0f08 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:15.326858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-86e19854-862a-43e5-b665-e6b4b56e0f08 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for user 5af228b237eb4e93baf30ade75bdca98 and project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:15.372546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-86e19854-862a-43e5-b665-e6b4b56e0f08 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.504016 Feb 07 04:16:15.375128 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 92/191] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Feb 7 04:16:13 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:15.493335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:15.509881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-98bf35ee-ce5c-421e-9e76-1b778554630f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.589293 Feb 07 04:16:15.512753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 100/192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:14 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:15.928874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:15.929561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:15.962653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:15.963111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:15.972350 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:15.973987 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:16.261634 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:16.277489 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c34c3d08-6c00-47e2-9c86-d195a141e34b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1275 microversion: 2.1 time: 0.354527 Feb 07 04:16:16.288637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 93/193] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:15 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:16.535013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:16.535013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:16.572534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:16.574170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:16.581043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:16.582403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:17.304768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:17.305383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:17.322878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:17.323337 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:17.337339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:17.338437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:18.055172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:18.063698 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b3671f66-60a7-42c8-a5ba-0fb307671798 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 1.538238 Feb 07 04:16:18.067151 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 101/194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:16 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:18.091615 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:18.111118 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d9934d78-0153-4a67-966e-2643c1570494 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.807841 Feb 07 04:16:18.125009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 94/195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:17 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:19.086228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:19.087572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:19.110507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:19.111479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:19.112584 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:19.113285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:19.134078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:19.134719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:19.149986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:19.150440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:19.151247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:19.166875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:19.653669 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:19.665851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a0ff15c3-1eef-4d4c-ba51-15c841d64522 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.583688 Feb 07 04:16:19.675349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 102/196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:19 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:20.692289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:20.693707 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:20.705751 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:20.706198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:20.715319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:20.715759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:21.495307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:21.503206 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e9f3e5b0-295a-4cbc-8a09-58284fc6b71f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.814492 Feb 07 04:16:21.503798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 103/197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:20 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:21.762647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-87145d07-620e-4513-9cec-5ebeb79f6d0a req-b8d5b2c3-99ae-4039-a861-97add735ef04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d93682d-b600-4636-ad86-a035be1c2500", "tag": "14881f67-cb42-40b9-a3da-ac9deed53950"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:21.764302 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:16:21.764302 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:16:21.777183 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-87145d07-620e-4513-9cec-5ebeb79f6d0a req-b8d5b2c3-99ae-4039-a861-97add735ef04 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:21.777850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-87145d07-620e-4513-9cec-5ebeb79f6d0a req-b8d5b2c3-99ae-4039-a861-97add735ef04 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:21.808435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-87145d07-620e-4513-9cec-5ebeb79f6d0a req-b8d5b2c3-99ae-4039-a861-97add735ef04 service nova] Creating event network-changed:14881f67-cb42-40b9-a3da-ac9deed53950 for instance 5d93682d-b600-4636-ad86-a035be1c2500 on hv-cinder-79963 Feb 07 04:16:21.830376 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-87145d07-620e-4513-9cec-5ebeb79f6d0a req-b8d5b2c3-99ae-4039-a861-97add735ef04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066206 Feb 07 04:16:21.834010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 104/198] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:16:22.159812 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:22.173808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dcdf206d-ec54-414a-83ae-fe09aa95b827 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 3.048680 Feb 07 04:16:22.175146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 95/199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:19 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 3050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:22.520536 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:22.521523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:22.532623 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:22.534812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:22.535985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:22.538054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:23.192902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:23.194301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:23.204140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:23.204853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:23.205865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:23.206493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:23.338065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:23.356857 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3298beac-b376-4142-bb8d-346805c61771 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.839436 Feb 07 04:16:23.357808 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 105/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:22 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:23.632848 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:23.649411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bfab3c78-cc82-444d-b759-ea4618280207 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.461736 Feb 07 04:16:23.675029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 96/201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:23 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:24.378146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:24.378760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:24.396594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:24.397059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:24.401225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:24.408146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:24.695978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:24.697110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:24.718170 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:24.721934 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:24.728132 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:24.728742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.078014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:25.086568 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0922288b-9b4e-4996-b7ec-22caf75292cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1500 microversion: 2.1 time: 0.713382 Feb 07 04:16:25.089404 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 106/202] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:24 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1500 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:25.182551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:25.190079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8785f070-7b7f-4a4e-bdef-0fc2fe74d561 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.500412 Feb 07 04:16:25.192175 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 97/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:24 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:25.216544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91e4df48-807f-4d15-b024-36247e396a3e"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:25.218159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:25.236583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:25.237336 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.238321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:25.238914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.304249 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] HTTP exception thrown: Cannot 'attach_volume' instance 8bb55652-6b90-48a0-8c34-def2934ea25d while it is in vm_state rescued Feb 07 04:16:25.304840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Returning 409 to user: Cannot 'attach_volume' instance 8bb55652-6b90-48a0-8c34-def2934ea25d while it is in vm_state rescued {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:16:25.321846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3c74c615-783b-49c5-81ca-4eb4f7bc2feb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.126384 Feb 07 04:16:25.325379 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 98/204] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:16:25 2022] POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 07 04:16:25.338323 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:25.339200 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:25.347301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:25.347983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.348982 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:25.349585 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.401462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-78498d51-ec84-4315-95a2-2c4ebf9c41bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: .version_select at 0x7f917b5d7280>, body: {"keypair": {"name": "tempest-keypair-125670800"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:25.444519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-78498d51-ec84-4315-95a2-2c4ebf9c41bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:25.451619 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-78498d51-ec84-4315-95a2-2c4ebf9c41bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for user 4ecfb108826147368ceb199e2e4da59e and project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:25.572095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-59261296-c15f-4bbf-a1bd-9024e513017d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action" status: 202 len: 0 microversion: 2.1 time: 0.237293 Feb 07 04:16:25.581046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 99/205] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:16:25 2022] POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 07 04:16:25.598861 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:25.606387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:25.656473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:25.656931 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.660782 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:25.671888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:25.930817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-78498d51-ec84-4315-95a2-2c4ebf9c41bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:25.948743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-78498d51-ec84-4315-95a2-2c4ebf9c41bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for user 4ecfb108826147368ceb199e2e4da59e and project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:25.966986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-78498d51-ec84-4315-95a2-2c4ebf9c41bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.874805 Feb 07 04:16:25.968312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 107/206] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Feb 7 04:16:25 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:26.208638 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:26.209701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:26.220027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:26.220506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:26.221309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:26.221757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:26.850041 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:26.861178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fbe0f8e5-f0d7-45c8-9f74-45a461eb6e8c tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.656071 Feb 07 04:16:26.861747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 108/207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:26 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:26.925246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:26.935830 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-024ef478-59ee-447a-bf91-cd90692d89d4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1508 microversion: 2.1 time: 1.351374 Feb 07 04:16:26.936650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 100/208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:25 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1508 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:27.876573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:27.877189 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:27.891387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:27.892156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:27.894313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:27.896581 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:27.957442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:27.958827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:27.979344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:27.980168 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:27.987536 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:27.989760 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:28.370295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:28.381395 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f1c7c6a2-dd76-4807-a39a-6939f149c20e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1508 microversion: 2.1 time: 0.431290 Feb 07 04:16:28.383058 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 101/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:27 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:28.548320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:28.562013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d83f2529-7428-4b5c-bfe9-4dc38edeb1af tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.688802 Feb 07 04:16:28.566744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 109/210] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:27 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:29.401214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:29.402568 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:29.428841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:29.429551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:29.434122 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:29.434799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:29.579572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:29.580391 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:29.589036 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:29.589488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:29.590297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:29.602211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:29.861874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:29.876469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2ea7babe-d726-4616-ad0e-370a3b885265 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1508 microversion: 2.1 time: 0.480224 Feb 07 04:16:29.885985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 102/211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:29 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:29.903434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-790273434", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "411cc7d3-f09c-4e43-9d10-7530e81fadb4"}], "security_groups": [{"name": "tempest-securitygroup--1689764960"}], "key_name": "tempest-keypair-125670800", "user_data": "}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:30.315606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:30.325677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5d8d3fdf-fe7a-47dc-97ef-47aaf3cf1e23 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.749882 Feb 07 04:16:30.343537 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 110/212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:29 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:30.901343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:30.902094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:30.909535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:30.936295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:30.952506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:30.953335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:31.315676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:31.327023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c60357b8-a39c-44e5-809c-18ab4e80a01e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1514 microversion: 2.1 time: 0.431531 Feb 07 04:16:31.335882 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 111/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:30 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1514 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:31.361607 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:31.365184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:31.395636 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:31.403638 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:31.411108 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:31.411712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:31.454746 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] validate_networks() for [('411cc7d3-f09c-4e43-9d10-7530e81fadb4', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:16:32.241736 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:32.251769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0943d20a-3c9a-4bfa-8d39-2ebc4c531b76 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.893675 Feb 07 04:16:32.257708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 112/214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:31 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:32.706839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:16:32.707307 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:16:32.707800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:16:32.708305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:16:32.708783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:16:32.728004 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:32.732016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:32.734544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:32.737789 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:32.838659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:32.857460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for user 4ecfb108826147368ceb199e2e4da59e and project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:32.921482 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:16:32.930103 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:16:33.041167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6fabd36b-e190-44cb-a5b3-f352fe651ec9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.161117 Feb 07 04:16:33.042005 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 103/215] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:16:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 3163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:16:33.051957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3f86777e-5b5e-4afa-b968-277c90aedc59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:33.052893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3f86777e-5b5e-4afa-b968-277c90aedc59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:33.258491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3f86777e-5b5e-4afa-b968-277c90aedc59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:33.273757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:33.274383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:33.275701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3f86777e-5b5e-4afa-b968-277c90aedc59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1236 microversion: 2.1 time: 0.224252 Feb 07 04:16:33.276344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 113/216] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:33 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1236 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:33.292079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:33.301865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:33.302734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:33.303175 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:33.757259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:33.768013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-37d170cb-3b5b-4d62-bb3b-4bca9cd39db0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.498925 Feb 07 04:16:33.769218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 104/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:33 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:34.293729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:34.294949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:34.325763 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.327560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.332545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.347935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.379577 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:34.381464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:34.399284 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.400596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.402808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.403810 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.604173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:34.615312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-55781b51-fe5f-4af5-a739-d29e500f1bbb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1288 microversion: 2.1 time: 0.325312 Feb 07 04:16:34.622131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 114/218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:34 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1288 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:34.626747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:34.638276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fc247006-a8b1-4cd1-8805-c2c34e056204 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1514 microversion: 2.1 time: 0.269943 Feb 07 04:16:34.639534 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 105/219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:34 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:34.658523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04d67dc8-6764-4a73-84bc-926c8d097202"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:34.659640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:34.670919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.671371 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.672196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.672636 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.784973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:34.785594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:34.796134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.801157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:34.802282 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:34.805156 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:35.348947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:35.356633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1dc13291-d082-45d1-a876-51023853135f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.575395 Feb 07 04:16:35.359151 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 106/220] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:34 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:35.578884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-023356dc-3f0e-4a50-aae8-d1b4f0a852fa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924501 Feb 07 04:16:35.580521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 115/221] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:16:34 2022] POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:16:35.639026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:35.639940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:35.666416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:35.667339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:35.669195 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:35.674625 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:36.027895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:36.030972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-cc247036-a2c0-4ee6-9f58-33751f3cb156 req-588fae3d-7e60-48be-b998-af9b6bfbd234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d93682d-b600-4636-ad86-a035be1c2500", "name": "network-vif-plugged", "status": "completed", "tag": "14881f67-cb42-40b9-a3da-ac9deed53950"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:36.033312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:16:36.033312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:16:36.037543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e364a5a2-3489-4a20-add2-4e6a6f7317f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1294 microversion: 2.1 time: 0.402022 Feb 07 04:16:36.051980 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-cc247036-a2c0-4ee6-9f58-33751f3cb156 req-588fae3d-7e60-48be-b998-af9b6bfbd234 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:36.052438 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 107/222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:35 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1294 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:36.072825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-cc247036-a2c0-4ee6-9f58-33751f3cb156 req-588fae3d-7e60-48be-b998-af9b6bfbd234 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:36.099389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-cc247036-a2c0-4ee6-9f58-33751f3cb156 req-588fae3d-7e60-48be-b998-af9b6bfbd234 service nova] Creating event network-vif-plugged:14881f67-cb42-40b9-a3da-ac9deed53950 for instance 5d93682d-b600-4636-ad86-a035be1c2500 on hv-cinder-79963 Feb 07 04:16:36.134704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-cc247036-a2c0-4ee6-9f58-33751f3cb156 req-588fae3d-7e60-48be-b998-af9b6bfbd234 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109869 Feb 07 04:16:36.147273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 116/223] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:16:36.375118 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:36.375729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:36.396623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:36.409452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:36.410591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:36.411186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:37.075344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:37.076179 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:37.091199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:37.091199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:37.095850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:37.097734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:37.338342 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:37.347651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-579e184a-3343-4a6b-a0a3-b42bb7242482 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.976529 Feb 07 04:16:37.366907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 108/224] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:36 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:37.430488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:37.440919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-57f894b2-4c41-494a-865a-6b8ae3d05f4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1294 microversion: 2.1 time: 0.369592 Feb 07 04:16:37.449640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 117/225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:37 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1294 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:38.374734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:38.375922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:38.386687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:38.389655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:38.393608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:38.394352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:38.467329 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:38.470074 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:38.485719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:38.486209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:38.487012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:38.487472 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:38.654786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:38.669683 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9a884d12-0f3f-4290-bfb1-8657d1d37e39 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1317 microversion: 2.1 time: 0.300138 Feb 07 04:16:38.670313 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 109/226] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:38 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:38.758728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:38.777201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ae93cc68-68e9-4be0-9fc9-de9961a1c5f3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.314996 Feb 07 04:16:38.783061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 118/227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:38 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:39.231385 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-42a5d33b-f6a3-42d5-b053-0107ad86c6b5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Action: 'create', calling method: .version_select at 0x7f917bf1cee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1825503725"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:39.288194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-42a5d33b-f6a3-42d5-b053-0107ad86c6b5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Getting quotas for project 2167e4b270e74390ab25c6bf679b1f4d. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:39.292956 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-42a5d33b-f6a3-42d5-b053-0107ad86c6b5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Getting quotas for user 591ab482084d4c6c80e9cc84d5d4d237 and project 2167e4b270e74390ab25c6bf679b1f4d. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:39.377330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-757a5086-7e4e-429d-adb4-9ea73b3587e4 req-e15b2de2-2e33-4e5f-98c4-036e2ca06281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb", "tag": "16d71b5a-130e-4a2a-ba8d-452f52e1fb61"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:39.379126 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:16:39.379126 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:16:39.387547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-757a5086-7e4e-429d-adb4-9ea73b3587e4 req-e15b2de2-2e33-4e5f-98c4-036e2ca06281 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:39.388285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-757a5086-7e4e-429d-adb4-9ea73b3587e4 req-e15b2de2-2e33-4e5f-98c4-036e2ca06281 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:39.401553 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-757a5086-7e4e-429d-adb4-9ea73b3587e4 req-e15b2de2-2e33-4e5f-98c4-036e2ca06281 service nova] Creating event network-changed:16d71b5a-130e-4a2a-ba8d-452f52e1fb61 for instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb on hv-cinder-79963 Feb 07 04:16:39.409277 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-757a5086-7e4e-429d-adb4-9ea73b3587e4 req-e15b2de2-2e33-4e5f-98c4-036e2ca06281 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037068 Feb 07 04:16:39.414898 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 119/228] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:16:39.530475 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-42a5d33b-f6a3-42d5-b053-0107ad86c6b5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Getting quotas for project 2167e4b270e74390ab25c6bf679b1f4d. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:39.552739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-42a5d33b-f6a3-42d5-b053-0107ad86c6b5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Getting quotas for user 591ab482084d4c6c80e9cc84d5d4d237 and project 2167e4b270e74390ab25c6bf679b1f4d. Resources: {'key_pairs'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:39.595162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-42a5d33b-f6a3-42d5-b053-0107ad86c6b5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.903067 Feb 07 04:16:39.598267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 110/229] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Feb 7 04:16:38 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:39.688520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:39.689238 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:39.710191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:39.711647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:39.712899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:39.713901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:39.800001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:39.800001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:39.818822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:39.825156 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:39.828236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:39.836689 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:40.171757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:40.181095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a0143576-bf4a-48a5-876f-1335a59078b5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1508 microversion: 2.1 time: 0.497878 Feb 07 04:16:40.184827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 120/230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:39 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:40.358350 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:40.366807 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2150d088-0b1d-4379-b69c-5345a98743ab tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.574594 Feb 07 04:16:40.376296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 111/231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:39 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:41.149381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6f723378-3b79-4614-8fd6-c23d6763f08e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Action: 'create', calling method: .version_select at 0x7f917b5f05e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1861838718"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:41.166140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-6f723378-3b79-4614-8fd6-c23d6763f08e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Getting quotas for project e0b4e3629fd9463cbb7ec690e5290d6d. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:41.170712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-6f723378-3b79-4614-8fd6-c23d6763f08e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Getting quotas for user 53c9f8b7b4cd4e45a33d4765769e49fe and project e0b4e3629fd9463cbb7ec690e5290d6d. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:41.382725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:41.383334 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:41.394616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:41.394616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:41.394616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:41.394616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:41.405762 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-6f723378-3b79-4614-8fd6-c23d6763f08e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Getting quotas for project e0b4e3629fd9463cbb7ec690e5290d6d. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:41.409732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-6f723378-3b79-4614-8fd6-c23d6763f08e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Getting quotas for user 53c9f8b7b4cd4e45a33d4765769e49fe and project e0b4e3629fd9463cbb7ec690e5290d6d. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:41.423895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6f723378-3b79-4614-8fd6-c23d6763f08e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.278192 Feb 07 04:16:41.429014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 121/232] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Feb 7 04:16:41 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:41.568454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:41.579688 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a398e038-2f8e-48fe-9db0-a4e853b7580b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.200752 Feb 07 04:16:41.580629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 112/233] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:41 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:41.604646 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2002286909", "imageRef": "30cfe710-6ec5-4182-bfdc-298e45bcb473", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1861838718", "networks": [{"uuid": "752f9bcd-f66a-4b46-888d-f131e2a320c5"}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:41.660182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] validate_networks() for [('752f9bcd-f66a-4b46-888d-f131e2a320c5', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:16:42.173035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:16:42.173616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:16:42.173927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:16:42.174339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:16:42.174750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:16:42.183648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:42.184130 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:42.184946 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:42.185381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:42.202794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Getting quotas for project e0b4e3629fd9463cbb7ec690e5290d6d. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:16:42.206872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Getting quotas for user 53c9f8b7b4cd4e45a33d4765769e49fe and project e0b4e3629fd9463cbb7ec690e5290d6d. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:16:42.218770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:16:42.221177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30cfe710-6ec5-4182-bfdc-298e45bcb473',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:16:42.268410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1b00f9b6-e176-437e-ae7b-08f9075880b2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668847 Feb 07 04:16:42.269070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 122/234] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 07 04:16:42.279727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e485f5ae-883a-4be2-a55a-b6b0803e5f2c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:42.280410 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e485f5ae-883a-4be2-a55a-b6b0803e5f2c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:42.343581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e485f5ae-883a-4be2-a55a-b6b0803e5f2c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:42.351622 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e485f5ae-883a-4be2-a55a-b6b0803e5f2c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1259 microversion: 2.1 time: 0.075706 Feb 07 04:16:42.352931 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 113/235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:42 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:42.596744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:42.597367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:42.603385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:42.603841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:42.604654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:42.605095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:42.749422 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:42.757185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8e4e77d8-f0e1-4d51-83e1-642b60e91f9e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.164265 Feb 07 04:16:42.759339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 123/236] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:42 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:42.831257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88a7bebd-c538-4329-b702-59f2a0b10e25"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:42.833040 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:42.839767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:42.840247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:42.841042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:42.841492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:43.209352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-90a51eea-99b7-42ec-a429-8ab9878e00f9 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382233 Feb 07 04:16:43.210606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 114/237] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:16:42 2022] POST /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:16:43.369930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:43.370540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:43.376864 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:43.377250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:43.378013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:43.378439 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:43.445122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:43.454222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-174908c4-e564-41e4-9543-6664e68700a1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1311 microversion: 2.1 time: 0.088263 Feb 07 04:16:43.454998 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 124/238] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:43 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:43.776606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:43.777563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:43.792909 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:43.793366 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:43.794235 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:43.794672 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:43.944867 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:43.954889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cbc37c50-ab8e-4ed8-9704-4f7f4140a63e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.183907 Feb 07 04:16:43.955290 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 115/239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:43 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:44.472032 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:44.472674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:44.483821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.484471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.486401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.487647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.618407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:44.631559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3ab24460-f6f9-437c-a8e5-f4ab444c013d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1317 microversion: 2.1 time: 0.163058 Feb 07 04:16:44.632336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 125/240] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:44 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:44.659069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:44.660327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:44.667875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.668497 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.669397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.669951 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.697551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lazy-loading 'flavor' on Instance uuid 8bb55652-6b90-48a0-8c34-def2934ea25d {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:16:44.893666 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bf7efaa2-40db-4503-9a11-2b21c82d1a37 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action" status: 200 len: 32 microversion: 2.1 time: 0.238006 Feb 07 04:16:44.894925 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 116/241] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:16:44 2022] POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 07 04:16:44.914361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:44.919800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:44.932551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.933417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.938012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.939401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.979242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:44.980034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:44.994118 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.994511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:44.995516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:44.995957 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:45.129893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:45.143806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2a262294-9393-491c-ae52-df325a2699d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.241016 Feb 07 04:16:45.145752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 126/242] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:44 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:45.394062 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:45.416142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8b4c662b-8075-45c8-8f88-defbcadd8ace tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.447261 Feb 07 04:16:45.428583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 117/243] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:44 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:45.650375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:45.651000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:45.658152 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:45.659159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:45.660148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:45.660788 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:45.826861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:45.846333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6c04bb90-1071-4afb-b675-1d5436bc15b7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.200891 Feb 07 04:16:45.847082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 127/244] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:45 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:46.164961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:46.166538 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:46.174020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.174981 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:46.175964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.176739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:46.420739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:46.430834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f6acae4e-12fa-4fc4-8908-b4048767ea42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.272159 Feb 07 04:16:46.431635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 118/245] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:46 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:46.438380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:46.439077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:46.449048 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.449972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:46.451114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.451872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:46.577437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-e27972fc-829e-414c-866a-9926398dbd80 req-d163a1fc-cf8b-464f-9072-2669aa0d2185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:46.579795 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:16:46.579795 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:16:46.595268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-e27972fc-829e-414c-866a-9926398dbd80 req-d163a1fc-cf8b-464f-9072-2669aa0d2185 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.606601 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-e27972fc-829e-414c-866a-9926398dbd80 req-d163a1fc-cf8b-464f-9072-2669aa0d2185 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:46.624078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-e27972fc-829e-414c-866a-9926398dbd80 req-d163a1fc-cf8b-464f-9072-2669aa0d2185 service nova] Creating event network-changed:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:16:46.629120 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-e27972fc-829e-414c-866a-9926398dbd80 req-d163a1fc-cf8b-464f-9072-2669aa0d2185 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062958 Feb 07 04:16:46.630280 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 119/246] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:16:46.663206 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:46.672792 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-08c697ab-2e56-4c31-88e6-1f26e949d308 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.242193 Feb 07 04:16:46.675122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 128/247] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:46 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:46.864690 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:46.865393 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:46.871865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.872443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:46.873225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:46.873656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:47.073824 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:47.081113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-89c81b1b-4129-4422-bcc2-d538175586ac tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.220925 Feb 07 04:16:47.081685 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 120/248] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:46 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:47.447989 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:47.448610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:47.454439 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:47.454903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:47.455683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:47.456153 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:47.621088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:47.630929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0b67d3b9-963a-4eb9-99ea-91e72943526c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.186676 Feb 07 04:16:47.631702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 129/249] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:47 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:47.690711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:47.691377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:47.700718 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:47.701112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:47.701910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:47.702348 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:47.907644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:47.915009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-af304acc-f97d-484b-ac77-4093dedca2c0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.228034 Feb 07 04:16:47.915575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 121/250] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:47 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:48.098192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:48.098799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:48.105155 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:48.105619 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:48.106371 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:48.106804 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:48.246674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:48.254821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2575a2ac-0df3-4207-bb3c-7ec53c6f5f65 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.160210 Feb 07 04:16:48.255604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 130/251] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:48 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:48.652678 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:48.653301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:48.661653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:48.662112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:48.663499 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:48.663937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:48.823246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:48.832329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-35ed5082-1d42-4a15-a1c8-d540d3a873b2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.183576 Feb 07 04:16:48.832896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 122/252] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:48 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:48.931426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:48.932181 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:48.938122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:48.939019 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:48.939919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:48.940495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:49.096220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:49.104192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fdcd1243-1228-4925-9581-2b1722cee241 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.176439 Feb 07 04:16:49.104801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 131/253] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:48 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:49.274773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:49.275817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:49.285611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:49.286067 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:49.286872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:49.287308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:49.431239 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:49.438467 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-01ff7981-1111-49e1-873f-b69227742ccb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.170058 Feb 07 04:16:49.439245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 123/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:49 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:49.849355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:49.850799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:49.863068 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:49.863912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:49.865005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:49.865696 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:50.061649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:50.077312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-940b9c3d-b2d7-4293-9e55-25b3d84f837b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.231441 Feb 07 04:16:50.077903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 132/255] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:49 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:50.121392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:50.122033 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:50.128383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:50.129042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:50.129821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:50.130257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:50.277790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:50.286295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8436bb9c-42d5-45d3-a3c4-ae71a8a2ac09 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.168516 Feb 07 04:16:50.286895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 124/256] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:50 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:50.457496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:50.458506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:50.466252 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:50.466759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:50.467653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:50.468166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:50.617524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:50.625207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b654a40b-2c4c-4ece-91bd-a970898fda34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.173080 Feb 07 04:16:50.625804 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 133/257] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:50 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:51.093595 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:51.094387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:51.101226 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:51.101687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:51.102514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:51.102981 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:51.253145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:51.260881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c1a4af80-a27f-4a53-9a32-22547a77243a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.171001 Feb 07 04:16:51.261465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 125/258] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:51 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:51.302760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:51.303503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:51.310433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:51.310879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:51.311905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:51.312520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:51.448611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:51.455800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d728a9be-5a6a-4a90-ac31-19f9b1b2cd0b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.156955 Feb 07 04:16:51.456395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 134/259] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:51 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:51.642374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:51.642997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:51.649282 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:51.649762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:51.650660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:51.651133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:51.818013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:51.825667 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-eba7c39c-f6e1-4f9f-b309-fa44e17a2a3c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.187016 Feb 07 04:16:51.832136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 126/260] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:51 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:52.279493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:52.280026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:52.286442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.286898 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.288285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.288728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.442044 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:52.451203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-125ef1e0-a412-47dd-beb1-168df918c303 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.175696 Feb 07 04:16:52.451779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 135/261] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:52 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:52.474023 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:52.474743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:52.481334 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.481773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.482572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.483028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.621300 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:52.628719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-02e2f145-9206-4f50-a8ec-92d60d5f15f1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.158455 Feb 07 04:16:52.629292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 127/262] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:52 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:52.848570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:52.849671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:52.866829 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.867748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.868856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.869659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.923718 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-9c88671a-5829-4c30-a0ff-3b27d82bb87d req-a34dd6e4-c999-4243-9236-81f6d084dadb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb", "name": "network-vif-plugged", "status": "completed", "tag": "16d71b5a-130e-4a2a-ba8d-452f52e1fb61"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:16:52.925659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:16:52.925659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:16:52.941001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-9c88671a-5829-4c30-a0ff-3b27d82bb87d req-a34dd6e4-c999-4243-9236-81f6d084dadb service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:52.941207 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-9c88671a-5829-4c30-a0ff-3b27d82bb87d req-a34dd6e4-c999-4243-9236-81f6d084dadb service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:52.968999 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-9c88671a-5829-4c30-a0ff-3b27d82bb87d req-a34dd6e4-c999-4243-9236-81f6d084dadb service nova] Creating event network-vif-plugged:16d71b5a-130e-4a2a-ba8d-452f52e1fb61 for instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb on hv-cinder-79963 Feb 07 04:16:52.973502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-9c88671a-5829-4c30-a0ff-3b27d82bb87d req-a34dd6e4-c999-4243-9236-81f6d084dadb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053368 Feb 07 04:16:52.974406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 128/263] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:16:53.060648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:53.067896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d015d99f-0657-4d32-bbc6-9389836e7c0c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.224263 Feb 07 04:16:53.068495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 136/264] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:52 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:53.469236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:53.469874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:53.476291 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:53.476953 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:53.477526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:53.477962 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:53.632995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:53.642713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-563c1701-01b3-4553-8808-ee34911dbf42 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.176704 Feb 07 04:16:53.642713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 129/265] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:53 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:53.646247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:53.647229 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:53.654626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:53.655198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:53.656340 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:53.656979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:53.808308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:53.815637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-173b4ea5-62b5-4999-b3ca-5c44cb0f5e01 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.173099 Feb 07 04:16:53.825284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 137/266] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:53 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:16:54.086820 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:54.087354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:54.093605 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:54.094085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:54.094871 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:54.095312 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:54.234348 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:54.241422 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a18e8728-bb87-4767-b47c-5517549d7e99 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.158951 Feb 07 04:16:54.241979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 130/267] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:54 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:54.659223 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:54.660351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:54.667971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:54.670499 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:54.671377 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:54.671824 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:54.808374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:54.817520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bd3b5a5e-4309-4138-8576-1ece66597a8c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.162251 Feb 07 04:16:54.818102 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 138/268] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:54 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:54.832632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:54.837003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:54.843587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:54.844177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:54.844888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:54.845328 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:55.008036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:55.022417 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2e7a90f8-5bb0-46ce-af5f-b150e2983ed4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.193038 Feb 07 04:16:55.023461 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 131/269] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:54 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:55.258488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:55.259005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:55.265011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:55.265430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:55.266216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:55.266651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:55.427317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:55.435324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-08b7d671-ffc0-4ae1-b663-4ed7b2eb2cad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.181128 Feb 07 04:16:55.436119 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 139/270] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:55 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:55.833819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:55.835059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:55.841453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:55.842144 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:55.842961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:55.843406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:55.987209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:55.995754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2fd124ae-b900-4afe-8197-03e3f4be4960 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.165610 Feb 07 04:16:55.996546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 132/271] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:55 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:56.040602 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:56.041380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:56.048112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:56.048803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:56.049787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:56.050224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:56.395268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:56.404862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3ba6a1cb-c792-4700-8cd2-d9dcd46a8fbd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.367752 Feb 07 04:16:56.406497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 140/272] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:56 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:56.455956 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:56.456524 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:56.462387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:56.462834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:56.463689 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:56.464159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:56.613405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:56.620737 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c11d9391-0572-4c28-8ef4-001375c51903 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.168368 Feb 07 04:16:56.621314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 133/273] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:56 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:57.011704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:57.012340 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:57.018241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:57.018691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:57.019468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:57.019905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:57.155476 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:57.164150 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2da51cf9-e65d-481f-81c5-da0ac5a5a679 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.155985 Feb 07 04:16:57.165506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 141/274] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:57 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:57.422526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:57.423245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:57.430179 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:57.430625 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:57.431406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:57.431835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:57.570846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:57.578449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cabcdae7-d25b-4e45-8a42-42cda285cb05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.159610 Feb 07 04:16:57.579023 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 134/275] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:57 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:57.637750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:57.638364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:57.644279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:57.644735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:57.645523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:57.645988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:57.788276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:57.795578 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-81a24308-a115-443a-923e-e653ef0d27c2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.161480 Feb 07 04:16:57.796163 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 142/276] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:57 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:58.185033 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:58.185867 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:58.192000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:58.192673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:58.194406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:58.194858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:58.388728 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:58.397053 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-88e9f54c-0c5f-4d62-98b6-c8e361ac7b10 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.216080 Feb 07 04:16:58.397844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 135/277] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:58 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:58.599071 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:58.599632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:58.606081 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:58.606526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:58.607308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:58.607739 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:58.748916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:58.756981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a31d60b4-026d-4f80-96bc-ce1ccd5afacd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.161027 Feb 07 04:16:58.757581 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 143/278] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:58 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:58.812211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:58.812813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:58.819596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:58.820078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:58.820849 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:58.821291 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:58.955026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:58.966432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e5a027db-ca92-4113-a33e-e10d11e63381 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.157742 Feb 07 04:16:58.967035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 136/279] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:58 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:59.415038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:59.415642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:59.421352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:59.421800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:59.422565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:59.422997 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:59.564519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:59.572832 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-32666940-8173-42df-a9b0-44a0b384a17a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.161960 Feb 07 04:16:59.573398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 144/280] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:59 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:59.774435 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:59.775074 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:59.781414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:59.781960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:59.782817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:59.783293 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:16:59.917524 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:16:59.925169 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-653b9923-9042-4383-bfab-60b8536a2bfc tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.155021 Feb 07 04:16:59.926666 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 137/281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:59 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:16:59.984941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:16:59.985759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:16:59.998018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:16:59.998885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:00.000819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:00.001446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:00.143204 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:00.151448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-37fce9b8-3629-4374-8f96-69aafed1afae tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.170542 Feb 07 04:17:00.152033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 145/282] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:16:59 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:00.589876 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:00.590481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:00.596428 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:00.596875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:00.597910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:00.598343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:00.745771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:00.754052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fefc14ea-6ba6-4254-81c1-a7ee2219be28 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.167691 Feb 07 04:17:00.759965 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 138/283] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:00 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:00.941854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:00.942467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:00.949245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:00.949639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:00.950427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:00.950872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:01.085570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:01.092988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4ece11cc-3e9c-4c14-87bc-8c5dfa610e9b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.154761 Feb 07 04:17:01.093563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 146/284] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:00 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:01.168307 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:01.169539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:01.175865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:01.176359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:01.177212 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:01.177667 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:01.321322 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:01.328543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9991b0bc-1b4f-4534-86a9-f13d6e748424 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.163729 Feb 07 04:17:01.329108 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 139/285] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:01 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:01.770397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:01.771024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:01.777295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:01.777742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:01.778505 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:01.779190 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:01.924161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:01.931730 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b8b3f7d1-1152-4800-b290-9bae1066c394 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.165048 Feb 07 04:17:01.932319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 147/286] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:01 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:02.109582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:02.110174 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:02.116172 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:02.116623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:02.117400 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:02.117838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:02.249769 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:02.257431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a4f077ee-3fcb-469c-9b7e-d5ae0223094d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.151720 Feb 07 04:17:02.257986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 140/287] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:02 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:02.345328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:02.345936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:02.352258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:02.352786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:02.353569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:02.354001 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:02.482059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:02.489165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-72a20049-dc84-4243-acea-388ea4631314 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.147563 Feb 07 04:17:02.489729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 148/288] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:02 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:02.948101 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:02.948634 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:02.954573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:02.955028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:02.955813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:02.956281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:03.083288 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:03.091096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b38d9914-42a5-4661-8506-e9caba226abc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.146804 Feb 07 04:17:03.091669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 141/289] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:02 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:03.274477 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:03.275093 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:03.281256 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:03.281712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:03.282488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:03.282926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:03.417249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:03.424482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-37ad724a-7839-4887-a263-257fd9800e27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.154138 Feb 07 04:17:03.425050 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 149/290] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:03 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:03.505601 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:03.506169 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:03.512386 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:03.512838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:03.513613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:03.514049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:03.650049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:03.657416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3afba892-defd-46ad-8c45-a9fba8d2362c tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.155511 Feb 07 04:17:03.657978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 142/291] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:03 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:04.108226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:04.108769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:04.114666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:04.115272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:04.116064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:04.116497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:04.245141 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:04.252751 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3210103b-a7ca-4909-9931-cccc93a94cce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.148304 Feb 07 04:17:04.253312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 150/292] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:04 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:04.440778 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:04.441391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:04.447697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:04.448183 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:04.448974 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:04.449414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:04.578759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:04.586098 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5db250b6-a0c6-48cf-8bd5-50b1959e3991 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.148934 Feb 07 04:17:04.586664 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 143/293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:04 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:04.673734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:04.674349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:04.680578 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:04.681030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:04.681812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:04.682259 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:04.825855 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:04.832995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-81fbc47f-150e-4f66-a467-96217764ba0e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.162907 Feb 07 04:17:04.833551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 151/294] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:04 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:05.269681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:05.270296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:05.276687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:05.277141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:05.277925 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:05.278360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:05.420838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:05.428582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-074a611a-1a0a-4949-be93-c0bed6bf5d5e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.162720 Feb 07 04:17:05.429152 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 144/295] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:05 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:05.602264 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:05.602878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:05.608695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:05.609149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:05.609943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:05.610376 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:05.740626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:05.748469 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c5de8492-d5b5-49b0-b05b-2247f0bc263f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.149687 Feb 07 04:17:05.749146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 152/296] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:05 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:05.849469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:05.850659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:05.857250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:05.857704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:05.858490 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:05.858933 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:05.990677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:05.997838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bcd758c7-a80f-4638-aa9e-dab79e61d966 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.152073 Feb 07 04:17:05.998405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 145/297] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:05 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:06.445322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:06.445943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:06.451726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:06.452225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:06.453043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:06.453488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:06.583289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:06.591169 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-098d934c-ccf4-4084-a0cd-a781e6e86833 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.150081 Feb 07 04:17:06.592161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 153/298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:06 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:06.765973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:06.766587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:06.772433 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:06.772883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:06.773665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:06.774103 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:06.907870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:06.917112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-47c67114-383b-4117-950d-e18e1bf535d3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.154764 Feb 07 04:17:06.917672 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 146/299] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:06 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:07.014241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:07.014850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:07.021837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:07.022296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:07.023074 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:07.023511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:07.154617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:07.161784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d0a5789c-082c-477a-bbba-ccc44ea537dd tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.151193 Feb 07 04:17:07.162907 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 154/300] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:07 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:07.608573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:07.609178 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:07.615449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:07.615895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:07.616695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:07.617127 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:07.749267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:07.757879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-04aaf9da-6146-458f-ad64-8f1401b117c0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.152873 Feb 07 04:17:07.758449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 147/301] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:07 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:07.934424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:07.935065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:07.940919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:07.941374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:07.942149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:07.942582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:08.072273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:08.079396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-cd59d6c7-c8ec-47c6-bda6-2333d2cf8b36 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.148602 Feb 07 04:17:08.079959 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 155/302] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:07 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:08.178881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:08.179495 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:08.185864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:08.186319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:08.187105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:08.187546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:08.314272 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:08.321885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dbad6184-7d76-45cd-be91-321233bf5125 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.146796 Feb 07 04:17:08.322476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 148/303] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:08 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:08.774419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:08.775018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:08.781257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:08.781704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:08.782471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:08.782903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:08.916777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:08.924483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c9d8dfe9-f3dc-45aa-8605-5c342d6b15a0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.153747 Feb 07 04:17:08.925052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 156/304] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:08 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:09.096441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:09.097050 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:09.103261 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:09.103711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:09.104514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:09.104954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:09.232801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:09.239906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-423af71b-d931-4ea2-8ec7-3b1968b3c168 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.147067 Feb 07 04:17:09.241039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 149/305] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:09 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:09.338759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:09.339374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:09.345581 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:09.346037 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:09.346881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:09.347325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:09.477164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:09.484232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-330d5285-955c-48d7-ace0-7fdf902a4689 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.149093 Feb 07 04:17:09.484790 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 157/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:09 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:09.940704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:09.941313 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:09.947886 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:09.948363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:09.949136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:09.949564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:10.089872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:10.097641 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-59623da7-8e4b-4114-a27a-5e8baa53e25e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.160530 Feb 07 04:17:10.098199 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 150/307] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:09 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:10.257956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:10.258614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:10.265444 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:10.265989 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:10.266855 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:10.267289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:10.401952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:10.409611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-80b9c113-71b5-4462-ae83-2e47e34e4391 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.155856 Feb 07 04:17:10.410352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 158/308] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:10 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:10.499893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:10.500579 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:10.506897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:10.507374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:10.508215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:10.508694 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:10.637155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:10.644256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6623d9e7-2507-41c5-988c-a209493b013b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.147963 Feb 07 04:17:10.644819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 151/309] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:10 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:11.114287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:11.114911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:11.120800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:11.121256 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:11.122040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:11.122481 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:11.255518 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:11.263701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-269fcb3b-fda0-4cd4-b618-26d9ab46f2c5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.153082 Feb 07 04:17:11.264297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 159/310] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:11 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:11.426736 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:11.427375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:11.433210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:11.433659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:11.434432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:11.434867 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:11.660628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:11.661359 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:11.667984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:11.668570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:11.669424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:11.669937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:11.765225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:11.772463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5be5e4e0-3d17-44f5-8074-d11d8545f651 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.349334 Feb 07 04:17:11.773040 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 152/311] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:11 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:11.804597 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:11.811852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-08830dec-fc8c-4189-83ea-0addd9196ec7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.155009 Feb 07 04:17:11.812578 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 160/312] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:11 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:12.280354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:12.280964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:12.286744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:12.287201 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:12.287985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:12.289124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:12.419758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:12.427734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-efe0d7cf-6f38-4c6e-8c04-3cb80ecd9f4c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.151279 Feb 07 04:17:12.428329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 153/313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:12 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:12.789997 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:12.790590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:12.796767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:12.797216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:12.797981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:12.798412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:12.829724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:12.830408 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:12.836749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:12.839558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:12.839558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:12.839558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:12.944635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:12.953970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e5e2bec2-0c26-4c24-8fc2-eba7a627a350 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.168096 Feb 07 04:17:12.954596 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 161/314] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:12 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:12.980424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:12.987676 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e542e709-bf85-4b2f-a98d-79d2d64172dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.161575 Feb 07 04:17:12.988458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 154/315] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:12 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:13.455070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:13.455676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:13.461996 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:13.462437 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:13.463203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:13.463634 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:13.591431 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:13.599125 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a3f9e697-9a0f-4166-b65f-b9ff97bb09ab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.147666 Feb 07 04:17:13.599681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 162/316] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:13 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:13.971900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:13.972483 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:13.978694 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:13.979148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:13.979927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:13.980395 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:14.004350 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:14.005040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:14.011894 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:14.012456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:14.013310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:14.013818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:14.115514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:14.123500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8d717080-f88d-49c5-b45d-c0d8ff91a6a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.155236 Feb 07 04:17:14.124095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 155/317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:13 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:14.161996 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:14.169741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-979d5fec-db88-4b81-9f22-759746d32812 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.168972 Feb 07 04:17:14.170308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 163/318] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:13 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:14.615097 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:14.615700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:14.622139 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:14.622591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:14.623363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:14.623802 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:14.750625 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:14.759230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-97363018-a674-4818-ae27-5af155cd7d0a tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.147788 Feb 07 04:17:14.759794 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 156/319] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:14 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:15.140339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:15.140956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:15.147184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:15.147644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:15.148451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:15.148899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:15.186844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:15.187543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:15.194013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:15.194468 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:15.195250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:15.195683 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:15.288628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:15.296615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-542f2328-50db-412d-9c5c-97838e3de333 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.160115 Feb 07 04:17:15.297177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 164/320] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:15 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:15.332364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:15.339912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ac34bf5a-ee7a-4323-b651-535ed974b4da tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156708 Feb 07 04:17:15.340494 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 157/321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:15 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:15.776965 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:15.777652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:15.783747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:15.784362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:15.785138 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:15.785612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:15.916563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:15.924537 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1cfd6ec6-d8f6-489f-a65d-82c768ab5e92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.152888 Feb 07 04:17:15.925095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 165/322] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:15 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:16.313167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:16.313772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:16.319946 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:16.320427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:16.321874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:16.322301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:16.356667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:16.357386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:16.363375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:16.363903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:16.364800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:16.365304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:16.453070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:16.460476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a1c9aceb-3066-4204-870f-9396855f815d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.150877 Feb 07 04:17:16.461096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 158/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:16 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:16.501845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:16.508991 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8b99ecdd-4353-4b32-afbd-9c60dbf05370 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.155944 Feb 07 04:17:16.509547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 166/324] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:16 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:16.941643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:16.942257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:16.948686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:16.949136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:16.949913 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:16.950349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:17.082185 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:17.089989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-af6a8398-45fa-46f1-bf5a-d03d3e77acfb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.151875 Feb 07 04:17:17.090543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 159/325] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:16 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:17.476979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:17.478192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:17.484427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:17.484878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:17.485660 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:17.486094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:17.525205 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:17.525902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:17.532363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:17.532805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:17.533801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:17.534230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:17.617563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:17.624941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a3dcbfca-3cd0-4793-9e47-346a25c67a4e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.151636 Feb 07 04:17:17.625571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 167/326] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:17 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:17.664765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:17.672762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bd8a5d00-4cab-42ae-9ff8-3d3d896eda16 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.151819 Feb 07 04:17:17.673318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 160/327] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:17 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:18.106190 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:18.106799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:18.112468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:18.112917 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:18.113696 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:18.114132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:18.249719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:18.257541 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-01975300-868a-4233-afa4-a6633d7a4a92 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.154976 Feb 07 04:17:18.258104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 168/328] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:18 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:18.642295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:18.642956 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:18.649138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:18.649580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:18.650375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:18.650808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:18.689113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:18.689723 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:18.695984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:18.696468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:18.697254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:18.697688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:18.786640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:18.794653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d092e5da-2331-46bc-88e8-76fcd2b4c776 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.156019 Feb 07 04:17:18.795318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 161/329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:18 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:18.834654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:18.841849 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-71669fe7-9f02-4bc4-bc83-16110ac23be1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156375 Feb 07 04:17:18.842458 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 169/330] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:18 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:19.274554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:19.275670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:19.281590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:19.282044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:19.282826 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:19.283262 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:19.416565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:19.425762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8a805540-54d0-42b0-aa42-802b308c1474 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.153936 Feb 07 04:17:19.425762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 162/331] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:19 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:19.811322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:19.811930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:19.818079 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:19.818530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:19.819303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:19.819738 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:19.858709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:19.859310 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:19.865687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:19.866136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:19.866917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:19.867344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:19.959797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:19.967643 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-84f1d4ff-f28c-4f59-bb54-9b98919325b3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.159973 Feb 07 04:17:19.968250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 170/332] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:19 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:20.000149 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:20.007427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a4e28cbb-5698-47e0-8066-675053a1c201 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.152329 Feb 07 04:17:20.007984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 163/333] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:19 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:20.441543 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:20.442157 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:20.449361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:20.449879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:20.450674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:20.451116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:20.589880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:20.597591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9f3a4046-375c-44a3-a09e-99542a4eee62 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.159822 Feb 07 04:17:20.598158 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 171/334] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:20 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:20.984815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:20.985422 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:20.991642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:20.992031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:20.992831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:20.993266 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:21.023737 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:21.024351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:21.030897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:21.031353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:21.032237 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:21.032684 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:21.129797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:21.137419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-865ae57f-90a5-4fe8-8d98-4e75cd5eb1c4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.156256 Feb 07 04:17:21.138170 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 164/335] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:20 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:21.162202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:21.169972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5aba57e2-e539-4ac3-b7fd-f1fafebec9f1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.149935 Feb 07 04:17:21.170529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 172/336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:21 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:21.613434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:21.614044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:21.619813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:21.620297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:21.621073 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:21.621504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:21.750621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:21.758391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e73dffb4-82d5-4a1c-a385-28c5d39e40d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.148576 Feb 07 04:17:21.758958 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 165/337] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:21 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:22.154160 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:22.155322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:22.161556 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:22.162010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:22.162790 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:22.163253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:22.186351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:22.187078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:22.193336 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:22.193781 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:22.194553 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:22.194981 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:22.300381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:22.308421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8b64633f-34ff-4756-bbde-7b5740391360 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.158971 Feb 07 04:17:22.309205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 173/338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:22 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:22.331010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:22.339043 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-631430cc-f622-4e5c-a1de-95f5fdacab2b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156309 Feb 07 04:17:22.339600 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 166/339] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:22 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:22.775205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:22.775814 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:22.782015 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:22.782471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:22.783255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:22.783695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:22.918687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:22.927696 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2d732305-ee01-4e5c-8bf3-a1f8db5dbd95 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.156100 Feb 07 04:17:22.928285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 174/340] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:22 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:23.325035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:23.325633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:23.331785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:23.332301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:23.333065 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:23.333498 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:23.356612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:23.358121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:23.365900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:23.366682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:23.367905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:23.369493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:23.473957 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:23.484851 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3391e605-bdc3-4d96-b6cb-2ab974b94984 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.163051 Feb 07 04:17:23.485448 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 167/341] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:23 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:23.522702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:23.530719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d841240b-9c1b-44bd-bb6a-24595f8fd31d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.178397 Feb 07 04:17:23.531277 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 175/342] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:23 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:23.944726 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:23.945255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:23.951329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:23.951783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:23.952583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:23.953015 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:24.083298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:24.091986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dd0b3e76-de81-48fd-810b-fc081ef32a17 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.150975 Feb 07 04:17:24.092767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 168/343] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:23 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:24.501562 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:24.502111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:24.508425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:24.508874 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:24.509648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:24.510084 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:24.547645 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:24.548345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:24.555021 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:24.555481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:24.556328 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:24.556748 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:24.652185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:24.661888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0871f961-df10-4ed0-a2c7-7aa98b7de28a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.163917 Feb 07 04:17:24.662462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 176/344] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:24 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:24.695970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:24.703713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dc52d8d1-60ab-4223-8e0e-c3af5b5b2794 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.160034 Feb 07 04:17:24.704318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 169/345] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:24 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:25.110272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:25.110878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:25.116735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:25.117221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:25.117992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:25.118436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:25.256211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:25.267343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9b6011a7-ea7c-4f53-a89e-99a02d16255d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.160731 Feb 07 04:17:25.267915 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 177/346] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:25 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:25.678481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:25.679289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:25.687682 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:25.688177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:25.688970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:25.689410 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:25.720799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:25.721479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:25.728432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:25.728882 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:25.730427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:25.730863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:25.828917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:25.836218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e5cc9b28-f11b-43f7-b1c1-5b4119e8b277 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.161367 Feb 07 04:17:25.836941 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 170/347] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:25 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:25.868193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:25.875282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fdc77e0f-0c5e-45fc-80ec-4025147d4540 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.158242 Feb 07 04:17:25.876009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 178/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:25 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:26.285363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:26.286082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:26.292376 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:26.292833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:26.293633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:26.294088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:26.435888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:26.443744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-aa7c63a9-c74b-48bb-bbcd-c9d549998c14 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.161997 Feb 07 04:17:26.444347 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 171/349] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:26 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:26.853367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:26.854022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:26.860355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:26.860815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:26.861600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:26.862043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:26.894610 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:26.895319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:26.902391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:26.902841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:26.903902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:26.904377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:27.045171 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:27.052973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-32a78d80-d23b-45e7-b3c2-74e23e17b88a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.203318 Feb 07 04:17:27.054236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 179/350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:26 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:27.068963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:27.076624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8ab65846-90f8-4245-84c0-c492cdd72caa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.188372 Feb 07 04:17:27.077173 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 172/351] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:26 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:27.460758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:27.461367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:27.467614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:27.468079 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:27.468861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:27.469291 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:27.613097 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:27.620950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4caae271-2196-456a-81d5-97e2837b0040 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.163722 Feb 07 04:17:27.621521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 180/352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:27 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:28.070551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:28.071099 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:28.079278 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:28.079750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:28.080581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:28.081034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:28.097385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:28.098010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:28.108105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:28.108105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:28.112216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:28.116629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:28.231669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:28.238959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b981a309-762b-4af2-9383-e5772fee9f06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.172136 Feb 07 04:17:28.239527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 173/353] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:28 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:28.261398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:28.268519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f1e0dd25-2819-47dd-95f4-4fd99f3255dc tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.178324 Feb 07 04:17:28.269073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 181/354] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:28 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:28.637883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:28.638488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:28.644279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:28.644725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:28.645500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:28.645954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:28.774964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:28.783294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c406e06e-ac50-4eef-bd1c-e8fdd32cfc9f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.149535 Feb 07 04:17:28.783856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 174/355] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:28 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:29.256102 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:29.256677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:29.263411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:29.263861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:29.264672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:29.265107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:29.285113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:29.285724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:29.291987 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:29.292472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:29.293276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:29.293715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:29.395547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:29.402890 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4859053f-17ba-4724-acb4-bf6ce6a54df7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.150527 Feb 07 04:17:29.403715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 182/356] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:29 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:29.427690 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:29.435649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ef088c48-4e63-4d72-bbb0-1326daf9a76b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.154155 Feb 07 04:17:29.436295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 175/357] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:29 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:29.800401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:29.801015 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:29.806807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:29.807255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:29.808017 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:29.809103 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:29.941540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:29.949866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f04e73bc-1fdd-4c9b-a4bf-5d20bcec6f5d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.153069 Feb 07 04:17:29.950426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 183/358] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:29 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:30.420618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:30.421233 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:30.427400 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:30.427864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:30.428690 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:30.429133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:30.451903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:30.452548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:30.458941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:30.459514 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:30.460744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:30.461338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:30.560917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:30.568219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-00cec003-3c34-42b3-8e93-92a33aedb9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.151845 Feb 07 04:17:30.568797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 176/359] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:30 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:30.597734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:30.604847 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c0e96091-e6b1-4f1a-8cc5-9c9b6e618769 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156510 Feb 07 04:17:30.605402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 184/360] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:30 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:30.966455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:30.967046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:30.972818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:30.973268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:30.974056 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:30.974487 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:31.116582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:31.124516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d9f3c35e-dc92-45f3-bd7d-700823e81d82 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.161689 Feb 07 04:17:31.125077 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 177/361] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:30 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:31.585753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:31.586369 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:31.593277 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:31.593728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:31.594515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:31.594954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:31.621817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:31.622461 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:31.629135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:31.629679 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:31.630472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:31.630906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:31.726966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:31.734747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b11f8e46-967e-4fd7-9cc2-5705ef5a7d06 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.153829 Feb 07 04:17:31.735316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 185/362] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:31 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:31.764572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:31.771676 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4e981e07-4d9c-4816-9fde-7ec9bf80598f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.153475 Feb 07 04:17:31.772263 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 178/363] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:31 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:32.140950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:32.141348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:32.147104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:32.147591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:32.148405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:32.148846 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:32.287832 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:32.296374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-32e439d1-07db-48cc-94d4-d15aa9bb7a9c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.159123 Feb 07 04:17:32.296946 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 186/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:32 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:32.752010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:32.752637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:32.758928 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:32.759321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:32.760121 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:32.760557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:32.789693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:32.790337 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:32.797366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:32.797828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:32.798625 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:32.799067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:32.903155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:32.910953 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a0d321bf-2306-4dce-878c-da52d136082d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.163230 Feb 07 04:17:32.911531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 179/365] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:32 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:32.940310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:32.947944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a3934e76-abc4-488f-afbe-b30af0d74803 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.161721 Feb 07 04:17:32.948831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 187/366] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:32 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:33.312954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:33.313566 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:33.319317 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:33.319771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:33.320589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:33.321032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:33.453023 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:33.460711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1eb8c92b-068b-4ad5-978e-0eeaa96e54d0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.151336 Feb 07 04:17:33.461276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 180/367] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:33 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:33.927842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:33.928563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:33.934777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:33.935223 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:33.935991 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:33.936445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:33.965396 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:33.966010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:33.972847 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:33.973293 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:33.974069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:33.974528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:34.069586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:34.077306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-05600b90-ece7-453a-b062-f8cdb0e65869 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.153110 Feb 07 04:17:34.077873 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 188/368] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:33 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:34.104968 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:34.112721 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-400014fd-d2b5-49ec-b61d-fd13f6b9cac5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.150934 Feb 07 04:17:34.113448 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 181/369] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:33 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:34.477273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:34.477879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:34.484320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:34.484766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:34.485537 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:34.485966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:34.617551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:34.625196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3657d9ab-1c4f-4a79-b8e5-b2aec53eb0a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.151728 Feb 07 04:17:34.625773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 189/370] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:34 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:35.094593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:35.095204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:35.101435 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:35.101884 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:35.102660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:35.103095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:35.131757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:35.132932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:35.142673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:35.143462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:35.144798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:35.145549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:35.240960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:35.250326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-353aa44a-13a7-4764-b289-64fb0eec994d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.159861 Feb 07 04:17:35.250904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 182/371] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:35 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:35.291001 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:35.298839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3bc15962-0a2c-4523-ab02-afc4a419c20e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.173259 Feb 07 04:17:35.299404 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 190/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:35 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:35.641533 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:35.642075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:35.647931 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:35.648407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:35.649182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:35.649616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:35.780595 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:35.788224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d1816aa3-6fd6-4579-8a08-6f0e4d220984 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.150905 Feb 07 04:17:35.788784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 183/373] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:35 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:36.267266 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:36.267880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:36.274235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:36.274686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:36.275468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:36.275906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:36.315392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:36.316034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:36.322324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:36.322779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:36.323565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:36.324003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:36.416681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:36.424384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-af8c6c11-5b22-4353-a3ec-d0b4ce9d6fdd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.160711 Feb 07 04:17:36.424986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 191/374] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:36 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:36.460653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:36.467937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3f335d06-af6e-46f0-baa0-4ce3f96f3e34 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156195 Feb 07 04:17:36.468540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 184/375] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:36 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:36.804665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:36.805276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:36.811005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:36.811453 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:36.812285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:36.812720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:36.944576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:36.952872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1ab9fd49-dc8b-40de-ae23-8cb7a589e08d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.151801 Feb 07 04:17:36.953436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 192/376] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:36 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:37.441187 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:37.441791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:37.447872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:37.448343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:37.449113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:37.449543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:37.484905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:37.485516 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:37.492652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:37.493151 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:37.493933 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:37.494366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:37.584374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:37.592230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-68279979-e156-41a7-acb7-cc1aa32872f2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.154534 Feb 07 04:17:37.592798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 185/377] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:37 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:37.630800 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:37.637878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-75877d54-fd54-428f-899c-6068ffb28dc9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156944 Feb 07 04:17:37.638959 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 193/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:37 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:37.969439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:37.970054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:37.976129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:37.976589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:37.977368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:37.977808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:38.113590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:38.121503 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-13ccbcdc-2334-4cc4-a0b5-a80fa3dc8aad tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.155728 Feb 07 04:17:38.122069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 186/379] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:37 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:38.609297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:38.609843 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:38.616207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:38.616658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:38.617614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:38.618050 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:38.655142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:38.655843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:38.661930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:38.662465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:38.663344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:38.663866 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:38.756467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:38.763787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1a797167-ce3f-4f41-a6fa-1193c2a58eca tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.158229 Feb 07 04:17:38.764625 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 194/380] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:38 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:38.806917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:38.816258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e7e9a709-5f76-4b3f-9d06-e372dd1a1a24 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.165415 Feb 07 04:17:38.817276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 187/381] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:38 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:39.138964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:39.139586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:39.145610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:39.146070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:39.146891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:39.147504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:39.285164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:39.292939 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1f63af40-b682-47e1-b568-38e64c6b450d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.158133 Feb 07 04:17:39.293517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 195/382] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:39 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:39.780860 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:39.781465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:39.787616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:39.788080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:39.788856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:39.789288 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:39.832440 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:39.833086 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:39.839411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:39.839870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:39.840681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:39.841166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:39.929929 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:39.937716 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9a00e688-e832-4474-9349-3c399e25c6ee tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.160741 Feb 07 04:17:39.938277 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 188/383] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:39 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:39.977025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:39.984811 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-25069ac3-2ce6-4ef7-a0a5-5aaee8c3daa7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156036 Feb 07 04:17:39.985372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 196/384] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:39 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:40.310347 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:40.310953 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:40.316837 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:40.317283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:40.318257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:40.318745 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:40.522655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:40.530729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-79476061-dba7-4ca9-b63d-2a3aa644723f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.224529 Feb 07 04:17:40.532704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 189/385] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:40 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:40.953724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:40.955063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:40.960658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:40.961405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:40.962424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:40.962868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:41.002693 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:41.003356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:41.009612 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:41.010067 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:41.010854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:41.011292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:41.095523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:41.103682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-29ada1f7-5c31-4442-96eb-206afec2a8c6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.153450 Feb 07 04:17:41.104303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 197/386] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:40 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:41.143069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:41.150291 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-397f30fe-1534-48af-8483-a0c030de2f03 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.152828 Feb 07 04:17:41.150852 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 190/387] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:40 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:41.547726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:41.548486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:41.555884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:41.556374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:41.557160 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:41.557603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:41.695088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:41.703348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ba983eff-95d3-496e-9941-6e9f1b7c7eab tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.159693 Feb 07 04:17:41.703900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 198/388] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:41 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:42.121501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:42.122114 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:42.128434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:42.128889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:42.129670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:42.130110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:42.166299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:42.166912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:42.173303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:42.173758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:42.174556 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:42.174995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:42.266041 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:42.273647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-758e7210-8e86-4805-b8a9-574213442df3 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.155778 Feb 07 04:17:42.274751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 191/389] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:42 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:42.312629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:42.319850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-40b039b1-2579-4197-906f-b5e726a4168f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.157131 Feb 07 04:17:42.320438 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 199/390] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:42 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:42.720176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:42.720718 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:42.726707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:42.727154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:42.728035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:42.728505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:42.858046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:42.874090 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-529278e8-e342-40c0-b09a-df922a47d4cb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.158067 Feb 07 04:17:42.874659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 192/391] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:42 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:43.291722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:43.292295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:43.299061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:43.299517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:43.300330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:43.300772 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:43.336725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:43.337356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:43.344397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:43.344849 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:43.345637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:43.346078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:43.431255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:43.438940 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-816750c8-d7a3-481a-8910-0e39e371e2bd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.150898 Feb 07 04:17:43.439511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 200/392] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:43 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:43.477109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:43.484740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e5189738-20d9-4920-9ebb-fc552274eee6 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.151531 Feb 07 04:17:43.485298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 193/393] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:43 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:43.891327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:43.891937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:43.897903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:43.898297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:43.899085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:43.899520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:44.031689 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:44.039372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7f79626c-b637-46a3-a5f1-898f383c1e29 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.152295 Feb 07 04:17:44.039938 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 201/394] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:43 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:44.455660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:44.456420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:44.462697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:44.463153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:44.464068 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:44.464569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:44.501111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:44.501837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:44.508288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:44.508745 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:44.509533 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:44.509972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:44.607223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:44.614613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4337a031-58c1-4df4-a80b-0229c6a83e76 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.162507 Feb 07 04:17:44.615203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 194/395] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:44 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:44.654508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:44.661726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-98628a42-9b2d-4589-8c40-94957e291674 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.164329 Feb 07 04:17:44.662287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 202/396] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:44 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:45.056468 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:45.057078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:45.063414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:45.063869 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:45.064742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:45.065180 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:45.195389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:45.203673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4b5957b9-77f1-4e78-82db-52ce66189fef tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.150784 Feb 07 04:17:45.204196 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 195/397] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:45 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:45.630479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:45.631089 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:45.637254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:45.637787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:45.639094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:45.639526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:45.678329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:45.678933 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:45.685678 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:45.686128 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:45.686912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:45.687345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:45.779140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:45.786367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-29f5500f-d4d1-45d3-afae-18d40cc4d53a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.159615 Feb 07 04:17:45.786928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 203/398] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:45 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:45.821573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:45.829340 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d77ccdc8-9a56-4dd9-a62b-bacd41361269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.154627 Feb 07 04:17:45.829904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 196/399] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:45 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:46.219894 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:46.220491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:46.226205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:46.226651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:46.227417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:46.227846 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:46.356524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:46.364694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a01eebbd-7629-4402-9393-5529de91323b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.148422 Feb 07 04:17:46.365261 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 204/400] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:46 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:46.802265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:46.802899 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:46.809131 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:46.809612 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:46.810926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:46.811365 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:46.845488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:46.846095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:46.852325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:46.852769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:46.853552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:46.853979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:46.947209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:46.957137 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f49666e9-e3fb-4031-ad03-20bb880ae205 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.158349 Feb 07 04:17:46.957970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 197/401] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:46 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:47.000660 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:47.007885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5afa43a0-9973-4fac-ad63-c608d0c35691 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.165943 Feb 07 04:17:47.008481 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 205/402] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:46 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:47.380874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:47.381477 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:47.387267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:47.388259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:47.389036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:47.389470 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:47.522191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:47.530189 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4dccd1d4-5ce2-41c6-b4e1-63734a81b773 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.152972 Feb 07 04:17:47.530759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 198/403] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:47 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:47.974463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:47.975103 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:47.981331 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:47.981801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:47.982575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:47.983011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:48.024635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:48.025244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:48.032427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:48.032882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:48.033722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:48.034111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:48.120960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:48.128380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2d6fda1a-90cc-4673-b4e5-856ad076fd00 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.157555 Feb 07 04:17:48.128954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 206/404] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:47 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:48.168735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:48.176268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-867cad68-54ab-4e1c-810b-4ccbc287e1ff tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.155043 Feb 07 04:17:48.176840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 199/405] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:48 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:48.547002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:48.547613 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:48.553588 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:48.554048 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:48.555168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:48.555618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:48.683364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:48.691035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-eca3fed7-29f5-41bd-9426-a054b20fafe0 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.148287 Feb 07 04:17:48.691601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 207/406] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:48 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:49.145174 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:49.145776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:49.151934 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.152606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.154194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.154632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.192807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:49.193414 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:49.199671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.200651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.201434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.201863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.305677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:49.314006 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2f13bba4-fa70-420b-b790-147a42cf3132 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.172441 Feb 07 04:17:49.314725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 200/407] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:49 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:49.360355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:49.368728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1a95a2e7-4fcc-45cc-847b-c561f8a1014e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.179430 Feb 07 04:17:49.369302 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 208/408] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:49 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:49.706303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:49.706933 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:49.709605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88a7bebd-c538-4329-b702-59f2a0b10e25"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:17:49.710746 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:49.713007 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.713458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.714236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.714673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.716526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.716979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.717769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.718217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.796310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] HTTP exception thrown: Invalid volume: volume 88a7bebd-c538-4329-b702-59f2a0b10e25 is already attached to instances: 5d93682d-b600-4636-ad86-a035be1c2500 Feb 07 04:17:49.797188 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Returning 400 to user: Invalid volume: volume 88a7bebd-c538-4329-b702-59f2a0b10e25 is already attached to instances: 5d93682d-b600-4636-ad86-a035be1c2500 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:17:49.798070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a7dc3321-ee5b-4c36-b00b-5a736b28fa88 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092856 Feb 07 04:17:49.798793 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 209/409] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:17:49 2022] POST /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 07 04:17:49.857828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:49.858330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:49.863787 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:49.864307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.864765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.865557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:49.865996 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:49.872061 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1ae10eb6-0023-4b96-866f-6b5d302602e7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.168890 Feb 07 04:17:49.872569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 201/410] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:49 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:49.945378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lazy-loading 'services' on Instance uuid 5d93682d-b600-4636-ad86-a035be1c2500 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:17:50.017924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d9af5d2e-afa4-461f-b189-84624be31184 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments/88a7bebd-c538-4329-b702-59f2a0b10e25" status: 202 len: 0 microversion: 2.1 time: 0.164013 Feb 07 04:17:50.018580 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 210/411] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:17:49 2022] DELETE /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments/88a7bebd-c538-4329-b702-59f2a0b10e25 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 07 04:17:50.026640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:50.027635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:50.034138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.034619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.035514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.035951 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.065701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d249434d-3f6d-4b92-ba5e-75c265ebca1d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Feb 07 04:17:50.066269 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 202/412] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:50 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:17:50.331406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:50.332130 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:50.338215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.338669 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.339449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.339888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.385413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:50.386120 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:50.392823 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.393354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.394176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.394618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.474375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:50.484026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6652e834-90da-49df-a14c-eecabe36582f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.157019 Feb 07 04:17:50.484823 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 211/413] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:50 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:50.543209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:50.550965 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3f06334f-9ac6-4488-a24b-13db1f3dbde5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.169193 Feb 07 04:17:50.551532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 203/414] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:50 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:50.888728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:50.889346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:50.895249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.895719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:50.896517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:50.896956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.031202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:51.039203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-81a7346c-bb49-478b-9949-13e1af263b20 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.154853 Feb 07 04:17:51.039753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 212/415] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:50 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:51.077640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:51.078516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:51.084478 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:51.084936 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.085726 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:51.086171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.114784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a1473c37-caf4-4908-b994-6ab9f2ec8dbe tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Feb 07 04:17:51.115327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 204/416] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:51 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:51.501868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:51.502486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:51.508836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:51.509281 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.510052 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:51.510508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.567914 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:51.568669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:51.574823 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:51.575294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.576090 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:51.576526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:51.653687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:51.660918 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5dbde86d-5125-4cb5-9c93-218dbb6ed8b2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.162652 Feb 07 04:17:51.661487 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 213/417] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:51 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:51.710937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:51.718709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-00cac17a-61b2-4d71-becf-cec6ec201a42 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.154477 Feb 07 04:17:51.719281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 205/418] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:51 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:52.056027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:52.056683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:52.063323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.063774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.064584 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.065024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.126154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:52.127096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:52.133199 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.133654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.134443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.134881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.164936 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7dea230a-1afa-46c4-b13e-86959911e596 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 Feb 07 04:17:52.165429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 206/419] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:52 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:17:52.196742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:52.205014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1f103576-665c-4264-8af9-ae66197eb8b3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.152843 Feb 07 04:17:52.205575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 214/420] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:52 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:52.678170 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:52.678767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:52.685593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.686038 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.686798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.687225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.734996 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:52.735525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:52.741753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.742202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.742979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:52.743413 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:52.819262 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:52.826465 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ae5ac7f4-7be4-46f7-bb91-597f658c5d8d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.151886 Feb 07 04:17:52.827030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 207/421] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:52 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:52.879787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:52.887118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9d881e9a-9f93-4f73-b666-c1d437d63c77 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.156300 Feb 07 04:17:52.887706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 215/422] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:52 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:53.175987 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:53.176913 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:53.182730 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.183176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.183944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.184952 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.212882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f56548f4-fe4e-4f53-9287-cb5ad54f7ed5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040664 Feb 07 04:17:53.213446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 208/423] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:53 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:53.221888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:53.222540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:53.228355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.228812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.229591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.230030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.358712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:53.366392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e32cf199-667d-4fce-99a4-5070597decf3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.148103 Feb 07 04:17:53.366965 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 216/424] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:53 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:53.843130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:53.843738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:53.849932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.850373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.851134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.851563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.903966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:53.904507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:53.911110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.911558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:53.912372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:53.912806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:54.006339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:54.014347 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-786c33b2-63a5-4198-accc-760ef296b06d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.174866 Feb 07 04:17:54.014902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 209/425] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:53 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:54.060398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:54.067486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f08af0bd-d32d-48ae-b1d7-85cdbe4ae18d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.167468 Feb 07 04:17:54.068067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 217/426] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:53 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:54.225052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:54.225907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:54.231901 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:54.232379 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:54.233159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:54.233663 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:54.264327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-70745213-a195-41cc-a146-f7b6a7ceea42 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 Feb 07 04:17:54.264890 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 210/427] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:54 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:54.382107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:54.382742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:54.389036 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:54.389482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:54.390275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:54.390704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:54.519734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:54.527744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-22523613-1590-4b99-b63c-c01fa2254cfd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.149446 Feb 07 04:17:54.528656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 218/428] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:54 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:55.030648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:55.031266 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:55.037427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.037880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.038665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.039109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.084542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:55.085149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:55.091363 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.091811 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.092640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.093097 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.180262 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:55.188622 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c371100e-5e99-4d3a-8a49-b54d1525444c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.161929 Feb 07 04:17:55.195336 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 211/429] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:55 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:55.236539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:55.243705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9aec6c60-510c-40e8-afef-fc7bdd971bfa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.162872 Feb 07 04:17:55.244304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 219/430] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:55 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:55.275575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:55.276527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:55.282852 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.283308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.284115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.284561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.313035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a82e3a4f-91c3-4a4a-9591-d42b85bc80ff tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Feb 07 04:17:55.313575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 212/431] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:55 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:55.545284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:55.545826 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:55.551689 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.552178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.552964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:55.553403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:55.685389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:55.693181 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-25f27098-8ed1-4b52-9ef2-4f1ce69a80b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.152162 Feb 07 04:17:55.693744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 220/432] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:55 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:56.205389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:56.205909 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:56.211828 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.212308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.213076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.213506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.261306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:56.261955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:56.267955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.268445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.269234 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.269673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.343995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:56.351456 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1f237ebe-8f98-43e8-b467-e12348316ddf tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.149752 Feb 07 04:17:56.352117 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 213/433] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:56 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:56.357107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:56.358081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:56.363818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.364373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.365248 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.365752 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.394766 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f771ca6c-af6a-454c-90cc-20393272e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041599 Feb 07 04:17:56.395416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 214/434] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:56 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:56.404963 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:56.412405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-11a105e1-61f2-4c0b-a91e-d61ee5ef87a5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.154905 Feb 07 04:17:56.412971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 221/435] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:56 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:56.709158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:56.709766 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:56.715580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.716567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.717346 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:56.717785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:56.851163 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:56.858880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5047ef5a-5935-4d7b-b2f7-2b2fea56a36e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.153311 Feb 07 04:17:56.859439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 215/436] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:56 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:57.368696 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:57.369454 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:57.376253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.376706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.377480 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.377917 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.406580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:57.407530 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:57.413931 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.414373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.415149 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.415579 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.446619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f3d22d03-2097-4f00-97e6-2008a5404ea5 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Feb 07 04:17:57.447712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 216/437] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:57 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:17:57.453305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:57.453982 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:57.460638 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.461085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.461868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.462298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.519038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:57.526835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2e27a102-4cb1-486c-a96b-8b86a65d4479 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1362 microversion: 2.1 time: 0.161799 Feb 07 04:17:57.527400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 222/438] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:57 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:57.593302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:57.600485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a70a7a2b-6baa-4754-9847-9cddc4f793ce tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.151613 Feb 07 04:17:57.601051 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 217/439] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:57 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:57.874339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:57.875306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:57.882167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.882619 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:57.883491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:57.883954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.014791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:58.022375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4b43c853-faf6-42f9-a469-211de21525a8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.151683 Feb 07 04:17:58.022931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 223/440] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:57 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:58.458597 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:58.459518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:58.466180 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.466614 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.467404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.467878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.517865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-807f3d18-2801-48a7-a29f-eb4b2ec0be3d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062981 Feb 07 04:17:58.518558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 218/441] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:58 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:58.543926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:58.544642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:58.556148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.557484 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.558533 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.560296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.617318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:58.618422 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:58.624949 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.626196 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.627174 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.627809 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.718467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:58.727088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7c6c1aaa-7002-4146-910a-becc8b3e031c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1549 microversion: 2.1 time: 0.187478 Feb 07 04:17:58.728092 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 224/442] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:58 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:58.748679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:58.749311 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:58.758829 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.759384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.760366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:58.760883 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:58.852207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e6f43175-dd83-46d8-afa8-15f9e1438f69 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111647 Feb 07 04:17:58.852914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 225/443] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Feb 7 04:17:58 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:17:58.902429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:58.910901 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bb18efa8-326f-4636-ad90-e9e75c6afe40 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.297446 Feb 07 04:17:58.918493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 219/444] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:58 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:17:59.039132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:59.039739 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:59.047890 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:59.048509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:59.049400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:59.049951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:59.491756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:17:59.504498 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-25088a9b-2a4a-4af3-b215-61ad4dbb35ac tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.468624 Feb 07 04:17:59.506251 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 226/445] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:59 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:17:59.529746 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:59.532127 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:59.548287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:59.548941 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:59.549740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:59.550181 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:59.582230 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-94b2f1c3-0b0e-479b-baa3-477450993a7f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056528 Feb 07 04:17:59.582971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 220/446] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:17:59 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:17:59.838642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1456989659", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1825503725", "security_groups": [{"name": "tempest-secgroup-smoke-1188663920"}], "networks": [{"uuid": "e1b98d4e-8309-43f2-8aa1-082023c2a074"}], "block_device_mapping_v2": [{"uuid": "77ef67a9-3b39-40ce-8abc-b4d1842570fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:17:59.930959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:17:59.930959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:17:59.936534 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:59.936995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:17:59.937888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:17:59.938442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.003362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] validate_networks() for [('e1b98d4e-8309-43f2-8aa1-082023c2a074', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:18:00.097636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:00.105011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2c7546b0-a731-4614-8314-453257f5eb9f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.180620 Feb 07 04:18:00.105651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 221/447] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:17:59 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:00.315205 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:00.316012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:00.322740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.323714 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.324904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.325501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.498275 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:00.506656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e9927cc9-fb3d-4a71-b58d-dab3db0cb3fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1549 microversion: 2.1 time: 0.195480 Feb 07 04:18:00.507458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 222/448] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:00 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:00.512181 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-3e2ea5ea-6fd2-4193-b916-acfa92625ec8 req-7e84f224-45db-4330-b248-2bb3af0bd881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb", "tag": "16d71b5a-130e-4a2a-ba8d-452f52e1fb61"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:00.513936 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:00.513936 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:00.522487 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-3e2ea5ea-6fd2-4193-b916-acfa92625ec8 req-7e84f224-45db-4330-b248-2bb3af0bd881 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.523147 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-3e2ea5ea-6fd2-4193-b916-acfa92625ec8 req-7e84f224-45db-4330-b248-2bb3af0bd881 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.536281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-3e2ea5ea-6fd2-4193-b916-acfa92625ec8 req-7e84f224-45db-4330-b248-2bb3af0bd881 service nova] Creating event network-changed:16d71b5a-130e-4a2a-ba8d-452f52e1fb61 for instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb on hv-cinder-79963 Feb 07 04:18:00.543810 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-3e2ea5ea-6fd2-4193-b916-acfa92625ec8 req-7e84f224-45db-4330-b248-2bb3af0bd881 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034769 Feb 07 04:18:00.544620 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 223/449] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:00.551517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1866173215", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1983533653", "security_groups": [{"name": "tempest-secgroup-smoke-1039050704"}], "block_device_mapping_v2": [{"uuid": "ec740df2-7003-4c33-a9b3-445c5630e783", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2380dba0-88cd-40c3-a56d-3005ce2546c4"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:00.557862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:18:00.558540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:18:00.559635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:18:00.560304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:18:00.560957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:18:00.569828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.570480 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.571707 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.572259 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.596865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Getting quotas for project 2167e4b270e74390ab25c6bf679b1f4d. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:18:00.602361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Getting quotas for user 591ab482084d4c6c80e9cc84d5d4d237 and project 2167e4b270e74390ab25c6bf679b1f4d. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:18:00.661876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:18:00.664270 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77ef67a9-3b39-40ce-8abc-b4d1842570fd',volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:18:00.699590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] validate_networks() for [('2380dba0-88cd-40c3-a56d-3005ce2546c4', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:18:00.818045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c6db5b51-be92-43dd-9203-ff794b66d16d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983061 Feb 07 04:18:00.822618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 227/450] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:17:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:18:00.832527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:00.833132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:00.841712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.842208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:00.842901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:00.843341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.042698 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:01.053923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d41c32e0-12eb-4e91-b65c-c717fff05935 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.224468 Feb 07 04:18:01.054932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 228/451] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:00 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:01.061177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:01.062154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:01.069658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.070853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.071835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.072470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.113301 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3e069b58-6e0c-4d3b-8dfb-d6277e8a021b tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057142 Feb 07 04:18:01.114216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 229/452] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:01 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:18:01.126644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3d3144f5-81e1-4a8e-92db-fa2846191367 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:01.127732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3d3144f5-81e1-4a8e-92db-fa2846191367 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:01.222274 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3d3144f5-81e1-4a8e-92db-fa2846191367 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:01.233620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3d3144f5-81e1-4a8e-92db-fa2846191367 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1089 microversion: 2.1 time: 0.116265 Feb 07 04:18:01.234240 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 230/453] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:01 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1089 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:01.239278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:01.240570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:01.250770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.251139 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.252146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.252585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.439488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:01.448114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b767b827-607c-4f18-a652-57e29617f202 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.212561 Feb 07 04:18:01.448967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 231/454] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:01 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:01.453771 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-727315064", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "7ca219ba-88c9-4d7f-a70f-fc6411c07502"}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:01.509935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] validate_networks() for [('7ca219ba-88c9-4d7f-a70f-fc6411c07502', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:18:01.716521 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:18:01.717638 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:18:01.718228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:18:01.718903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:18:01.719536 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:18:01.739704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.740960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.741906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.742453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.762827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:18:01.767079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for user 5af228b237eb4e93baf30ade75bdca98 and project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:18:01.829124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:18:01.831840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec740df2-7003-4c33-a9b3-445c5630e783',volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:18:01.939877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:18:01.940430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:18:01.941046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:18:01.941528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:18:01.942012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:18:01.951287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.951741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.952753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.953195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.955103 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-35927aef-c8f3-4bb9-99e8-b517c3c4efbf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.409115 Feb 07 04:18:01.955800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 224/455] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:18:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:18:01.960629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:01.961500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:01.968450 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.969165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.969676 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:01.970102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:01.990245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:18:01.994046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Getting quotas for user 4d4bef2b813144fab2053b3547694bbe and project 06d109aa9a364bed8b25935d5374bf3b. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:18:02.006161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:18:02.008435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:18:02.055496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a1cb5fbc-89a4-4b78-955e-91d9542846f2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605317 Feb 07 04:18:02.056253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 232/456] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:18:02.061102 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fff11496-0432-4ffa-8377-f68739448e80 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:02.062711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fff11496-0432-4ffa-8377-f68739448e80 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:02.124407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fff11496-0432-4ffa-8377-f68739448e80 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:02.131129 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fff11496-0432-4ffa-8377-f68739448e80 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1095 microversion: 2.1 time: 0.073868 Feb 07 04:18:02.131705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 233/457] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:02 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:02.140357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c5cbb572-fbac-4e1a-9fff-28352d741f0e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:02.140975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c5cbb572-fbac-4e1a-9fff-28352d741f0e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:02.157476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:02.167987 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b9659f82-70e1-4f18-96af-805c8695053b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1666 microversion: 2.1 time: 0.211040 Feb 07 04:18:02.170008 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 225/458] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:01 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1666 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:02.179532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:02.180164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:02.189351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.190062 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.191642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.192325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.217466 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c5cbb572-fbac-4e1a-9fff-28352d741f0e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:02.224719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c5cbb572-fbac-4e1a-9fff-28352d741f0e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1217 microversion: 2.1 time: 0.091951 Feb 07 04:18:02.227577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 234/459] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:02 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:02.232033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:02.232551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:02.240928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.241380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.256367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.257851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.313446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6486ed82-1d90-4a43-89cd-78814f15e9b4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/ips" status: 200 len: 145 microversion: 2.1 time: 0.084594 Feb 07 04:18:02.314260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 235/460] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Feb 7 04:18:02 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/ips => generated 145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:02.319139 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:02.319865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:02.327298 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.327868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.328949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.329604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.406997 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:02.415867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-28e271b0-8d9a-4895-b3b4-e81e94b2b5b2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1195 microversion: 2.1 time: 0.100627 Feb 07 04:18:02.417608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 236/461] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:02 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1195 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:02.469494 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:02.470497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:02.476243 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:02.484112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.484773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.486636 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:02.487248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:02.495285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7ccfb32f-8681-48c7-ad01-e34913e8bfbd tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.319078 Feb 07 04:18:02.496627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 226/462] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:02 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:02.680275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:02.692547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c3140b18-88ce-407d-8cc3-243d9ed24cd7 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.228953 Feb 07 04:18:02.693230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 237/463] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:02 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:03.150814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:03.152075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:03.162419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.163366 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.165550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.166387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.243120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:03.243795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:03.255839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.256719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.257906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.259987 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.280209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:03.289760 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8ba25a7a-4f20-4c44-904f-fdad8cf9fec6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1137 microversion: 2.1 time: 0.143936 Feb 07 04:18:03.292963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 227/464] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:03 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1137 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:03.408166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:03.428618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-eac1c076-11c9-4edc-91d7-583746e0fb1f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1269 microversion: 2.1 time: 0.189370 Feb 07 04:18:03.430814 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 238/465] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:03 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:03.434085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:03.435257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:03.449599 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.454649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.455523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.458463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.516793 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:03.518114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:03.524926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.525348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.526375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.526996 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.701818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:03.710917 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-72709b85-98c5-4f32-b2f6-ca479fe77670 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.200946 Feb 07 04:18:03.711517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 239/466] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:03 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:03.716117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:03.716729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:03.722667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.723099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.724030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:03.724498 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:03.791606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:03.800879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0c2a954a-9280-4681-a229-45ef77cfca5a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1273 microversion: 2.1 time: 0.370979 Feb 07 04:18:03.801619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 228/467] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:03 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:03.863249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:03.870588 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f71b955f-159d-4466-95b5-fe1322f6dc75 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.158117 Feb 07 04:18:03.880464 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 240/468] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:03 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:04.310485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:04.311168 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:04.319443 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-1a8c4d04-5d7e-4986-83b8-b0a6776279cf req-e7eb3a07-c5c8-4b3e-9b29-1dc7bc13b100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443b0913-1482-440f-b9e3-1fb5e8012d94", "tag": "17109406-6d8f-40f6-9417-ddb7abe58df8"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:04.321145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:04.321145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:04.337184 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.337803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.338701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.339287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.341423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-1a8c4d04-5d7e-4986-83b8-b0a6776279cf req-e7eb3a07-c5c8-4b3e-9b29-1dc7bc13b100 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.341880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-1a8c4d04-5d7e-4986-83b8-b0a6776279cf req-e7eb3a07-c5c8-4b3e-9b29-1dc7bc13b100 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.369515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-1a8c4d04-5d7e-4986-83b8-b0a6776279cf req-e7eb3a07-c5c8-4b3e-9b29-1dc7bc13b100 service nova] Creating event network-changed:17109406-6d8f-40f6-9417-ddb7abe58df8 for instance 443b0913-1482-440f-b9e3-1fb5e8012d94 on hv-cinder-79963 Feb 07 04:18:04.375231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-1a8c4d04-5d7e-4986-83b8-b0a6776279cf req-e7eb3a07-c5c8-4b3e-9b29-1dc7bc13b100 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059924 Feb 07 04:18:04.376492 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 241/469] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:04.417567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:04.425819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4e22d837-3f5b-404c-b504-885dcaf56829 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1193 microversion: 2.1 time: 0.119560 Feb 07 04:18:04.426425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 229/470] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:04 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1193 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:04.449395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:04.450787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:04.457320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.457783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.458583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.459023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.520754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:04.528692 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4bd5954a-5013-410e-a238-b52c4e081eb4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1287 microversion: 2.1 time: 0.083145 Feb 07 04:18:04.529160 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 242/471] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:04 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:04.727693 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:04.728429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:04.734895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.735353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.736175 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.736619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.818967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:04.819585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:04.826088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.826725 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.827640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.828098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.875525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:04.889870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-afa887e2-9b3a-41b1-ab86-52c06f31d470 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.165521 Feb 07 04:18:04.891093 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 230/472] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:04 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:04.895895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:04.896708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:04.902737 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.903769 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:04.904631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:04.905059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:05.114454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:05.125515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fb274338-e92b-420f-8a0e-91999d14cd00 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.232623 Feb 07 04:18:05.136909 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 231/473] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:04 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:05.314108 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:05.322054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c6e43b17-4c42-40dc-87c1-ac5c473fe2d1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.506924 Feb 07 04:18:05.322787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 243/474] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:04 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:05.443051 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:05.443979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:05.450747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:05.451203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:05.452198 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:05.452650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:05.546064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:05.546767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:05.555421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:05.556479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:05.557670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:05.558400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:05.560318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:05.577713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-01fbdee4-54fe-4d1d-b94e-e1711e787587 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1211 microversion: 2.1 time: 0.137417 Feb 07 04:18:05.580268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 232/475] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:05 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:05.659057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:05.668793 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-22a8ab80-1a74-4112-bdfd-d73cf7b1e597 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1275 microversion: 2.1 time: 0.127091 Feb 07 04:18:05.669587 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 244/476] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:05 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:05.907428 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:05.908333 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:05.915123 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:05.916013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:05.916943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:05.918477 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.146138 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:06.147441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:06.156919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.158372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.159548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.160245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.309105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:06.318014 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5d05c4a0-0fe6-4a2a-b856-5fc4a058e926 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1566 microversion: 2.1 time: 0.414475 Feb 07 04:18:06.328493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 233/477] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:05 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1566 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:06.344381 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:06.345594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:06.354094 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.355394 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.358080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.358819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.524724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:06.535019 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f2a1cf10-b731-4f26-8448-093522787677 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.395457 Feb 07 04:18:06.545834 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 245/478] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:06 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:06.596880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:06.598565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:06.606033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.607322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.608415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.609260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.888687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:06.903877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d949b998-b737-47bb-adef-18e8f4cebd7e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.309932 Feb 07 04:18:06.904751 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 246/479] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:06 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:06.909527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:06.910388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:06.916739 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.917424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.918436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:06.919038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:06.963216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:06.971728 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f7cf52d2-d227-4cc6-8093-ec25d8255590 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.634172 Feb 07 04:18:06.972522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 234/480] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:06 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:07.158981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:07.175111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-dd04159a-f2e4-40e0-9988-b8fff8477825 req-a6341327-b437-4f3b-9da0-1f3b37649827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73db778d-755d-49b4-b51b-0557e2b15b37", "tag": "ac94b66d-3a3d-43fe-82fe-267f8a81a9ea"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:07.176759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:07.176759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:07.187493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-dd04159a-f2e4-40e0-9988-b8fff8477825 req-a6341327-b437-4f3b-9da0-1f3b37649827 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.187857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-dd04159a-f2e4-40e0-9988-b8fff8477825 req-a6341327-b437-4f3b-9da0-1f3b37649827 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.193934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3b537b3a-f1c6-4caa-86f8-bf2755ae258d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.287629 Feb 07 04:18:07.205284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 247/481] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:06 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:07.205472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-dd04159a-f2e4-40e0-9988-b8fff8477825 req-a6341327-b437-4f3b-9da0-1f3b37649827 service nova] Creating event network-changed:ac94b66d-3a3d-43fe-82fe-267f8a81a9ea for instance 73db778d-755d-49b4-b51b-0557e2b15b37 on hv-cinder-79963 Feb 07 04:18:07.216590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-dd04159a-f2e4-40e0-9988-b8fff8477825 req-a6341327-b437-4f3b-9da0-1f3b37649827 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045135 Feb 07 04:18:07.221064 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 235/482] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:07.273816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-8e25a2ce-5d56-4e48-aa64-da9a982fa6dd req-8145aa44-7853-4892-a941-6cc74ad822fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "name": "network-vif-plugged", "status": "completed", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:07.277006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:07.277006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:07.289745 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-8e25a2ce-5d56-4e48-aa64-da9a982fa6dd req-8145aa44-7853-4892-a941-6cc74ad822fb service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.290497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-8e25a2ce-5d56-4e48-aa64-da9a982fa6dd req-8145aa44-7853-4892-a941-6cc74ad822fb service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.311055 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-8e25a2ce-5d56-4e48-aa64-da9a982fa6dd req-8145aa44-7853-4892-a941-6cc74ad822fb service nova] Creating event network-vif-plugged:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:18:07.316362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-8e25a2ce-5d56-4e48-aa64-da9a982fa6dd req-8145aa44-7853-4892-a941-6cc74ad822fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048243 Feb 07 04:18:07.317040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 248/483] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:07.336649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:07.337455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:07.345004 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.345804 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.347207 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.347641 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.552344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:07.553874 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:07.565076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.565920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.566973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.567650 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.613232 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:07.621866 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-db4ec401-2ce7-48fa-921c-240128c77b60 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1546 microversion: 2.1 time: 0.290063 Feb 07 04:18:07.622439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 236/484] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:07 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:07.641665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:07.642445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:07.651911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.652795 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.654841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.655554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.831223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] HTTP exception thrown: Cannot 'detach_volume' instance 8bb55652-6b90-48a0-8c34-def2934ea25d while it is in vm_state rescued Feb 07 04:18:07.832203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Returning 409 to user: Cannot 'detach_volume' instance 8bb55652-6b90-48a0-8c34-def2934ea25d while it is in vm_state rescued {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:18:07.833428 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-14b061bf-2f34-45f8-bcdc-81716d3b8237 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments/04d67dc8-6764-4a73-84bc-926c8d097202" status: 409 len: 152 microversion: 2.1 time: 0.196146 Feb 07 04:18:07.837402 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 237/485] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:18:07 2022] DELETE /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments/04d67dc8-6764-4a73-84bc-926c8d097202 => generated 152 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 07 04:18:07.842714 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:07.843186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:07.851078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.851531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.852366 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.852805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.875604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:07.896167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-275535c6-b560-44e9-b804-a7bfaaa4b423 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.347698 Feb 07 04:18:07.908270 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 249/486] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:07 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:07.922011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:07.922641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:07.935104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.935630 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.936920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.937541 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:07.971684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-04ed4860-db05-44fb-b888-fff183ea8409 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action" status: 202 len: 0 microversion: 2.1 time: 0.131734 Feb 07 04:18:07.972986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 238/487] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:18:07 2022] POST /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:18:07.978560 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-7c9ac939-8cac-4a3d-bfb2-20bf57b5a9a8 req-2b652fe7-be84-4e15-9687-4bc66606ff21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167dea27-bb6f-4570-bce1-655c26a20dbd", "tag": "d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:07.980259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:07.980259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:07.988929 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-7c9ac939-8cac-4a3d-bfb2-20bf57b5a9a8 req-2b652fe7-be84-4e15-9687-4bc66606ff21 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:07.989391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-7c9ac939-8cac-4a3d-bfb2-20bf57b5a9a8 req-2b652fe7-be84-4e15-9687-4bc66606ff21 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.001516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-7c9ac939-8cac-4a3d-bfb2-20bf57b5a9a8 req-2b652fe7-be84-4e15-9687-4bc66606ff21 service nova] Creating event network-changed:d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b for instance 167dea27-bb6f-4570-bce1-655c26a20dbd on hv-cinder-79963 Feb 07 04:18:08.006423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-7c9ac939-8cac-4a3d-bfb2-20bf57b5a9a8 req-2b652fe7-be84-4e15-9687-4bc66606ff21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Feb 07 04:18:08.007018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 239/488] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:08.011968 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:08.012751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:08.019682 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.020184 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.020951 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.021392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.105380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:08.116902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5fec5405-6622-4f8e-9133-ce1761d749d4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.199519 Feb 07 04:18:08.117581 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 250/489] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:07 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:08.123704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:08.124551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:08.130341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.130974 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.131759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.132228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.170066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:08.177972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-47fb3b76-a7ae-4974-bdd9-3bd5d2108350 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.169824 Feb 07 04:18:08.178531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 240/490] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:08 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:08.210354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:08.211137 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:08.217785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.218246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.219029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.219648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.266167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:08.273421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a79b3ca5-2b52-4ae0-ae6f-29cf32be3b77 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.154889 Feb 07 04:18:08.273986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 251/491] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:08 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:08.354173 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:08.361788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-76d14263-fe56-4e3d-bd01-b311c3a1d188 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.155031 Feb 07 04:18:08.362360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 241/492] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:08 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:08.914714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:08.915888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:08.923275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.923719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:08.924527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:08.924955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.130553 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:09.134015 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:09.135022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:09.140275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-01bad4cf-d4de-4c51-8df8-b96750e56908 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.229201 Feb 07 04:18:09.141126 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 252/493] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:08 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:09.141371 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.141820 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.142621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.143056 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.196825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:09.197376 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:09.203187 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.203644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.204466 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.204906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.337912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:09.346839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3aa12ec5-afa1-4227-ba8b-f9ef1d0d62b8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.155334 Feb 07 04:18:09.347421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 253/494] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:09 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:09.351868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:09.352570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:09.359202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.359656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.360529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.361506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.430054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:09.439079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9cb9ceab-f374-48a7-8f0d-63152012d996 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.308706 Feb 07 04:18:09.448392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 242/495] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:09 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:09.448392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:09.448392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:09.453183 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.453634 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.454416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:09.454850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:09.502161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:09.509441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5e6ae687-9179-4147-b3b1-996616ccc6ad tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.160829 Feb 07 04:18:09.510013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 254/496] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:09 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:09.671401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:09.678624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-17028b26-c99e-41b4-8536-fe094ef8d8fa tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.237458 Feb 07 04:18:09.679247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 243/497] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:09 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:10.157259 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:10.157870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:10.164143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.164598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.165370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.165807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.298865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:10.306038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4dd804cd-c506-4cb6-98b0-a5d7700e342b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.152647 Feb 07 04:18:10.306603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 255/498] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:10 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:10.364272 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:10.364878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:10.370996 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.371449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.372287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.372722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.455925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:10.456471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:10.462237 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.462687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.463500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.463937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.508757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:10.516413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1d6fab1b-11cc-49fd-863b-a087a4e1c24f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.155699 Feb 07 04:18:10.516980 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 244/499] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:10 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:10.525553 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:10.526154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:10.532721 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.533165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.533937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.534363 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.600634 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:10.608752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-947fce69-ffb8-4770-948c-370a07fe3be1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.156533 Feb 07 04:18:10.609502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 256/500] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:10 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:10.666402 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:10.674403 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-212aac04-1e91-47ff-a35e-6a8e11fea693 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.152209 Feb 07 04:18:10.674965 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 245/501] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:10 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:10.695233 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:10.695850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:10.702094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.702549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.703331 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:10.703770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:10.836970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:10.844901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bb511a8e-9321-4564-bcf5-82083e6825a1 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.153239 Feb 07 04:18:10.845472 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 257/502] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:10 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:11.322260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:11.322862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:11.329463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.329912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.330686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.331124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.533889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:11.534510 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:11.541094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.541550 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.542346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.542779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.685039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:11.689210 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:11.693500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-78328286-dabe-4c16-a42b-64920752d59b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1359 microversion: 2.1 time: 0.374874 Feb 07 04:18:11.694247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 246/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:11 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:11.698672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-aa038e1f-0cc0-4b3b-b93e-dcb3f22c4b05 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.168504 Feb 07 04:18:11.699062 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:11.706663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 258/504] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:11 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:11.706930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:11.707095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:11.707095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:11.707359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.707359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.707359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.707661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.712648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.713331 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.714592 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.715342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.843673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:11.851244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-172efe74-a8e9-47f7-a36e-bcce99b9f9e9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.156231 Feb 07 04:18:11.851815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 247/505] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:11 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:11.851971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:11.860149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-568a9e82-3654-4230-af74-8ec196feb435 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.159634 Feb 07 04:18:11.860866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 259/506] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:11 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:11.861778 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:11.862395 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:11.868089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.868543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:11.869318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:11.869757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.004075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:12.011225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7c23880b-9a50-4422-97d6-c7b3ba0f67e4 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.152924 Feb 07 04:18:12.011809 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 248/507] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:11 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:12.710546 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:12.711177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:12.715798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:12.716446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:12.717530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.717988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.718772 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.719209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.722948 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.723429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.724236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.724672 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.854983 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:12.858717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:12.863536 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6b239474-9fa5-4e23-af42-d33aa4f8d344 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1549 microversion: 2.1 time: 0.156193 Feb 07 04:18:12.864090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 260/508] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:12 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:12.866614 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a257fb14-a288-4080-8ae9-99a81854cfc3 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.154422 Feb 07 04:18:12.867323 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 249/509] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:12 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:12.868775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:12.869450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:12.875591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.876370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.877159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.877599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.881831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:12.881831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:12.886857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.887830 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:12.888644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:12.889082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.015245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:13.020392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:13.022855 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5299e422-6d07-46e1-a869-ee6929c2ba14 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.157683 Feb 07 04:18:13.023603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 261/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:12 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:13.028764 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:13.029081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b9d6ef98-8f39-40d9-b01e-0fe484e535b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1549 microversion: 2.1 time: 0.151414 Feb 07 04:18:13.029520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:13.029896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 250/511] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:12 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:13.034354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:13.034959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:13.035569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.036153 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.036987 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.037505 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.040853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.041311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.042088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.042543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.173899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:13.175240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:13.181328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d2d88448-e28d-4d90-b68c-de8aa4913f5f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.156748 Feb 07 04:18:13.181893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 262/512] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:13 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:13.189976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-478bb968-704b-4628-adb5-690bba88026d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.151817 Feb 07 04:18:13.189976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 251/513] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:13 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:13.190159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:13.190159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:13.190159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:13.190399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:13.191124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Searching by: {'deleted': False, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d'} {{(pid=116493) get_all /opt/stack/nova/nova/compute/api.py:2908}} Feb 07 04:18:13.197413 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.197853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.198650 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.199078 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.287050 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.multi_cell_list [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 07 04:18:13.378810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-03a4a9d7-e798-4fda-96ec-fc04b348208e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.195878 Feb 07 04:18:13.379389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 263/514] 10.222.0.13 () {58 vars in 1124 bytes} [Mon Feb 7 04:18:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:13.389869 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:13.390534 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:13.396374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.396825 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.397600 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.398034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.527236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:13.535220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-abb3a8e2-57f6-4b56-82ce-6ec071a58e67 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1549 microversion: 2.1 time: 0.149556 Feb 07 04:18:13.535786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 252/515] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:13 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:13.882810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:13.883419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:13.890360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.890806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:13.891576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:13.892009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.026505 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:14.039397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-261a9568-5a90-4eab-a8ba-fac15895c7a5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.160151 Feb 07 04:18:14.039972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 264/516] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:13 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:14.040312 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:14.040927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:14.052209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:14.052590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.053376 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:14.053809 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.192643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:14.198412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:14.199027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:14.199937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-93812cbb-a46e-4326-be25-e7b66ac9d6de tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.163198 Feb 07 04:18:14.200802 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 253/517] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:14 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:14.204889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:14.205069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:14.205491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:14.205598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.206297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:14.206817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.211012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:14.211469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.212434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:14.212875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:14.342529 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:14.343450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:14.349999 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4c97c69f-465f-40c4-af05-d7550169c310 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.148343 Feb 07 04:18:14.350591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 254/518] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:14 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:14.350694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-28a12786-5599-43fe-b2f0-716537c720fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.155926 Feb 07 04:18:14.351448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 265/519] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:14 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:15.057630 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:15.058232 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:15.064509 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.064958 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.065729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.066158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.199276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:15.207467 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4f90ff3b-8a95-42df-8bf9-52ccd7b6caca tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.153445 Feb 07 04:18:15.208139 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 255/520] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:15 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:15.217361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:15.218010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:15.224211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.224669 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.225463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.225900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.362907 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:15.367735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:15.368397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:15.372664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4dfb8333-de8c-4efa-afdb-fe578dd24cee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.159280 Feb 07 04:18:15.373295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 266/521] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:15 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:15.378026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:15.378641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:15.381739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.382183 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.383075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.383514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.384322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.384783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.385567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:15.386009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:15.524164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:15.524754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:15.532569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bb1302d6-2a0a-491e-bc1e-7bcf6b622fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.168629 Feb 07 04:18:15.532730 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-31d4fbc8-81e7-4805-8567-140dac9a04e4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.158374 Feb 07 04:18:15.533414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 256/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:15 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:15.533555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 267/523] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:15 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:16.054815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "392db1a2-81ae-4d13-9b5d-02ffa10ca8a2"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:16.055931 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:16.062089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.062630 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.063314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.063755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.224743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:16.225289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:16.231396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.231844 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.232652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.233085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.381699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:16.392984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fb81ca33-1e68-4310-a664-bc61af529ee1 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1554 microversion: 2.1 time: 0.171885 Feb 07 04:18:16.402694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 268/524] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:16 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:16.405868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5c55c2bb-cc8f-4c8f-adc4-0ff2fbcf56fa tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354455 Feb 07 04:18:16.407391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 257/525] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:18:16 2022] POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:16.408244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:16.409022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:16.416503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.416869 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.417619 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.418065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.549219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:16.549924 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:16.556582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.557038 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.557841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.558280 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.562054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:16.569254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-747dd2aa-c95a-4572-86fb-1f72dd739f24 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.164945 Feb 07 04:18:16.569824 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 269/526] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:16 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:16.574342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:16.575772 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:16.581681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.582134 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.582911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:16.583346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:16.697410 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:16.707133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-df30b509-5bd6-4c5e-96e7-f34b603c8a72 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.161863 Feb 07 04:18:16.707708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 258/527] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:16 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:16.726794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:16.734442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6d07fa7a-ceab-4cbf-8527-cc1842545975 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.163383 Feb 07 04:18:16.735004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 270/528] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:16 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:17.410090 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:17.410641 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:17.416956 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.417406 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.418181 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.418617 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.560926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:17.568586 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-51c6ec3c-5214-425c-b177-1d4687ed6de5 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1560 microversion: 2.1 time: 0.162327 Feb 07 04:18:17.569146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 259/529] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:17 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:17.585436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:17.586123 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:17.593350 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.593926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.594725 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.595193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.634157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:17.634652 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:17.640936 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.641475 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.642267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.642709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.719528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lazy-loading 'services' on Instance uuid 8bb55652-6b90-48a0-8c34-def2934ea25d {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:18:17.730859 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:17.738305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ae12535a-c6e8-4433-815e-0bfd71636181 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.156771 Feb 07 04:18:17.738985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 271/530] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:17 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:17.743242 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:17.743922 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:17.750164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.750616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.751401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.751842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.835276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-98077b97-5d73-418e-9b1a-e14e581c9f2c tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments/04d67dc8-6764-4a73-84bc-926c8d097202" status: 202 len: 0 microversion: 2.1 time: 0.204324 Feb 07 04:18:17.836000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 260/531] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:18:17 2022] DELETE /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments/04d67dc8-6764-4a73-84bc-926c8d097202 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 07 04:18:17.842636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:17.843287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:17.850242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.850727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.851492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.851924 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.913743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:17.922765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fa0af493-d049-4b27-8061-4c921b0f47b6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.182658 Feb 07 04:18:17.923339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 272/532] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:17 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:17.927768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:17.928754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:17.935278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.935845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.936747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:17.937255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:17.967937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a9e18793-5d3c-4037-a103-50acc72f1457 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Feb 07 04:18:17.968713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 273/533] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:17 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:18.006226 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:18.013513 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bd98c899-235d-424d-aa94-38a0c233b5e3 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.176394 Feb 07 04:18:18.014092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 261/534] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:17 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:18.755335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:18.756255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:18.762718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:18.763174 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:18.763956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:18.764486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:18.899448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:18.907560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b31c2a36-8978-4285-8c04-dd1c0f81fbbb tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.156026 Feb 07 04:18:18.908145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 274/535] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:18 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:18.938277 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:18.938880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:18.945064 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:18.945509 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:18.946271 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:18.946703 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:18.978629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:18.979543 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:18.985325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:18.985775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:18.986561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:18.987006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:19.015682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0fcbaecd-fe87-4a8b-ba65-ef7a3b225569 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040673 Feb 07 04:18:19.016280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 275/536] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:18 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:19.029671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:19.030275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:19.036073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:19.036540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:19.037317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:19.037755 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:19.082788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:19.090102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-48780ca6-6f54-475a-88e7-d117bde0b80a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.155347 Feb 07 04:18:19.091156 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 262/537] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:18 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:19.167025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:19.174162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0175a21a-c408-4b86-96f2-672144743178 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.148750 Feb 07 04:18:19.174927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 276/538] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:19 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:19.305504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-63e1d0d7-d444-4428-9c1c-84a1950e8dbd req-04fa2c1e-e0d2-43ee-bf4f-9c5c02f1431f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73db778d-755d-49b4-b51b-0557e2b15b37", "name": "network-vif-plugged", "status": "completed", "tag": "ac94b66d-3a3d-43fe-82fe-267f8a81a9ea"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:19.307176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:19.307176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:19.315753 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-63e1d0d7-d444-4428-9c1c-84a1950e8dbd req-04fa2c1e-e0d2-43ee-bf4f-9c5c02f1431f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:19.316218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-63e1d0d7-d444-4428-9c1c-84a1950e8dbd req-04fa2c1e-e0d2-43ee-bf4f-9c5c02f1431f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:19.328100 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-63e1d0d7-d444-4428-9c1c-84a1950e8dbd req-04fa2c1e-e0d2-43ee-bf4f-9c5c02f1431f service nova] Creating event network-vif-plugged:ac94b66d-3a3d-43fe-82fe-267f8a81a9ea for instance 73db778d-755d-49b4-b51b-0557e2b15b37 on hv-cinder-79963 Feb 07 04:18:19.332824 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-63e1d0d7-d444-4428-9c1c-84a1950e8dbd req-04fa2c1e-e0d2-43ee-bf4f-9c5c02f1431f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030893 Feb 07 04:18:19.333419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 263/539] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:19.924168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:19.924776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:19.931057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:19.931503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:19.932737 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:19.933170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.029486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:20.030527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:20.036451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:20.036908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.037696 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:20.038138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.066925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:20.067197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-12f0b6dd-2422-4926-9629-6bfd0888c23d tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Feb 07 04:18:20.067769 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 264/540] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:20 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:20.074309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-68783be0-1ef1-4765-9022-e7d4d8955712 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.153907 Feb 07 04:18:20.074858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 277/541] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:19 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:20.107020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:20.107621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:20.113256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:20.113707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.114508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:20.114945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.190697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:20.191232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:20.197027 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:20.197484 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.198299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:20.198733 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:20.246855 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:20.254312 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-76fae42f-2873-4449-8a6f-43d1e27a6bc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.151192 Feb 07 04:18:20.254962 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 265/542] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:20 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:20.329624 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:20.336776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-af06aaef-59df-43b2-a34c-e29f298363c0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.149901 Feb 07 04:18:20.337336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 278/543] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:20 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:21.078415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:21.079332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:21.085548 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.086036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.086819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.087260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.090811 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:21.091462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:21.097452 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.097912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.098691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.099131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.116994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5053197e-2fec-498b-ad74-f1041d8e15f2 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 Feb 07 04:18:21.117545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 266/544] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:21 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:21.233796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:21.241101 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-00cb53a3-b98d-4534-b12e-2481f07bfa39 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.154309 Feb 07 04:18:21.241670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 279/545] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:21 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:21.271123 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:21.271818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:21.278421 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.278917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.279705 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.280172 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.356785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:21.358070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:21.368306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.369321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.372338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.373258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.426515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:21.434387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-411817ba-893e-4fb7-aeb9-a0a9e6e5f213 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.166996 Feb 07 04:18:21.435184 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 267/546] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:21 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:21.480624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-e4bd5ffa-e297-4016-986e-cce244cbce42 req-9311040d-dbf7-482b-b896-ea5e9829d049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443b0913-1482-440f-b9e3-1fb5e8012d94", "name": "network-vif-plugged", "status": "completed", "tag": "17109406-6d8f-40f6-9417-ddb7abe58df8"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:21.482523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:21.482523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:21.490420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-e4bd5ffa-e297-4016-986e-cce244cbce42 req-9311040d-dbf7-482b-b896-ea5e9829d049 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:21.490873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-e4bd5ffa-e297-4016-986e-cce244cbce42 req-9311040d-dbf7-482b-b896-ea5e9829d049 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:21.504539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-e4bd5ffa-e297-4016-986e-cce244cbce42 req-9311040d-dbf7-482b-b896-ea5e9829d049 service nova] Creating event network-vif-plugged:17109406-6d8f-40f6-9417-ddb7abe58df8 for instance 443b0913-1482-440f-b9e3-1fb5e8012d94 on hv-cinder-79963 Feb 07 04:18:21.511236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-e4bd5ffa-e297-4016-986e-cce244cbce42 req-9311040d-dbf7-482b-b896-ea5e9829d049 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Feb 07 04:18:21.513104 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 268/547] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:21.706573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:21.718824 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-47c0f287-ab43-48b1-8bf4-8a01ea586cb7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.363650 Feb 07 04:18:21.718824 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 280/548] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:21 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:22.129524 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:22.130527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:22.136517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.136983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.137754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.138188 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.166092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a347572f-02c8-4065-9032-fc6ba6ab3893 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041137 Feb 07 04:18:22.166636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 269/549] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:22 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:22.257631 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:22.258165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:22.264982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.265435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.266218 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.266656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.395569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:22.402768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-de337afb-7a3a-45cd-8bcb-6ba9f910be3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.148831 Feb 07 04:18:22.403593 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 281/550] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:22 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:22.451089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:22.451694 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:22.457488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.457934 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.458704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.459141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.592801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:22.599926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a05d6939-033b-4e92-acb3-b407eea1ccc8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.153049 Feb 07 04:18:22.600539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 270/551] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:22 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:22.730441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:22.732006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:22.738037 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.738696 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.739725 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:22.740224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:22.878902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:22.886034 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-af557be2-8cd4-4b87-ad97-09d866652695 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.159489 Feb 07 04:18:22.886590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 282/552] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:22 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:23.178226 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:23.179162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:23.185427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.185866 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.186626 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.187058 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.215656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-df7f8815-2a95-4b38-8d69-b7cf5d71afff tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040704 Feb 07 04:18:23.216223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 271/553] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:23 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:23.419388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:23.419989 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:23.426183 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.426628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.427390 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.427817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.557562 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:23.564690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-59db37b2-5601-4e3b-96f4-3e27ba330b2c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.148954 Feb 07 04:18:23.565249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 283/554] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:23 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:23.617111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:23.617726 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:23.623534 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.623989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.624799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.625244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.763317 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:23.771538 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-71bcbc36-e5c0-46b1-bcdc-a0f356d51333 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.157996 Feb 07 04:18:23.772140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 272/555] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:23 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:23.902064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:23.902683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:23.908822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.909279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:23.910059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:23.910502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.041283 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:24.048448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-55ae2b37-b19d-4542-aa39-b3426ddaf308 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1317 microversion: 2.1 time: 0.150008 Feb 07 04:18:24.049017 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 284/556] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:23 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:24.226853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:24.227764 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:24.234458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:24.234911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.235692 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:24.236168 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.265320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2a39955d-52a1-4ebd-ab55-85a2fd8d54d8 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Feb 07 04:18:24.265881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 273/557] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:24 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:24.581279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:24.581943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:24.588065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:24.588530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.589309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:24.589746 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.723074 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:24.730493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-cee47b07-5126-4ca8-8da9-609c3eff83d0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.152866 Feb 07 04:18:24.731676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 285/558] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:24 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:24.788214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:24.788853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:24.795441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:24.795889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.804540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:24.805026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:24.949216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:24.957013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b66aeefa-02f3-4cb1-86a8-acb80a438e3c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.172474 Feb 07 04:18:24.957566 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 274/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:24 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:25.064755 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:25.065382 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:25.071203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.071654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.072545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.072986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.206314 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:25.213678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a0edfaaa-cd6b-4856-8335-38ba6ec30c4d tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1507 microversion: 2.1 time: 0.152625 Feb 07 04:18:25.214243 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 286/560] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:25 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:25.276359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:25.277265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:25.283632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.284099 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.284871 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.285302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.313683 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ba5bae89-0de8-46ec-b769-b6430099ca6e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040979 Feb 07 04:18:25.317473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 275/561] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:25 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:25.748099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:25.748719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:25.755232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.755717 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.756523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.757039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.891637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:25.899260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e6456a64-1c18-4b84-ac44-096c27822616 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.155446 Feb 07 04:18:25.902195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 287/562] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:25 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:25.974046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:25.974777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:25.980830 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.982018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:25.982793 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:25.983223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:26.027347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:26.028510 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:26.034283 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:26.034728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:26.035535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:26.035928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:26.115625 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:26.122986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-81aac897-ded4-43d9-ba70-8e90600a10fd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.152559 Feb 07 04:18:26.123554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 276/563] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:25 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:26.166326 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:26.174550 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7f022ea1-c101-46e3-ba21-be26bfa59a41 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1595 microversion: 2.1 time: 0.150793 Feb 07 04:18:26.175110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 288/564] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:26 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:26.324604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:26.326086 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:26.332296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:26.332750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:26.333528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:26.333963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:26.362784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-92192904-b480-462a-b301-5898fc2d73bb tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Feb 07 04:18:26.363351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 277/565] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:26 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:26.916519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:26.917252 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:26.923867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:26.924615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:26.925482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:26.925994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.139048 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:27.139647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:27.145432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.145873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.146639 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.147071 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.221650 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:27.231445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ec374b4b-5434-4f40-88a8-4f2bd2893069 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.318757 Feb 07 04:18:27.232555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 289/566] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:26 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:27.300398 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:27.309586 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-216c3def-e6df-46df-ba9c-829e757de8c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.174517 Feb 07 04:18:27.312092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 278/567] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:27 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:27.361045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-13ebf0de-437e-47c8-8546-da8982527bee req-cea3c3ca-a08b-428e-a401-fa1b410e9bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167dea27-bb6f-4570-bce1-655c26a20dbd", "name": "network-vif-plugged", "status": "completed", "tag": "d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:27.363246 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:27.363246 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:27.373258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-13ebf0de-437e-47c8-8546-da8982527bee req-cea3c3ca-a08b-428e-a401-fa1b410e9bb9 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.373416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-13ebf0de-437e-47c8-8546-da8982527bee req-cea3c3ca-a08b-428e-a401-fa1b410e9bb9 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.378134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:27.379853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:27.385649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-13ebf0de-437e-47c8-8546-da8982527bee req-cea3c3ca-a08b-428e-a401-fa1b410e9bb9 service nova] Creating event network-vif-plugged:d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b for instance 167dea27-bb6f-4570-bce1-655c26a20dbd on hv-cinder-79963 Feb 07 04:18:27.388601 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.389242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.390036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.390491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.392467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-13ebf0de-437e-47c8-8546-da8982527bee req-cea3c3ca-a08b-428e-a401-fa1b410e9bb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036181 Feb 07 04:18:27.393837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 290/568] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:27.425220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d45bfacd-624d-4272-b68f-87ec44f693cc tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054739 Feb 07 04:18:27.425793 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 279/569] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:27 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:27.576630 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "832594ab-e7cc-47da-928e-30c47e6b3cd8"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:27.577806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:27.583850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.584338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.585129 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:27.585568 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:27.931984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-dc19ff4e-98a0-4a5e-8c58-023ee09bbb49 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "POST /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359962 Feb 07 04:18:27.932822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 291/570] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:18:27 2022] POST /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:28.227708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-b96c8d1f-7194-40e1-9537-f1b2c8c2782d req-835b5ac7-a983-43cf-8934-a889119522f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:28.229254 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:28.229254 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:28.236017 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-b96c8d1f-7194-40e1-9537-f1b2c8c2782d req-835b5ac7-a983-43cf-8934-a889119522f6 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.236535 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-b96c8d1f-7194-40e1-9537-f1b2c8c2782d req-835b5ac7-a983-43cf-8934-a889119522f6 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.251628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:28.252066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-b96c8d1f-7194-40e1-9537-f1b2c8c2782d req-835b5ac7-a983-43cf-8934-a889119522f6 service nova] Creating event network-changed:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:18:28.252929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:28.258395 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-b96c8d1f-7194-40e1-9537-f1b2c8c2782d req-835b5ac7-a983-43cf-8934-a889119522f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Feb 07 04:18:28.262024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 280/571] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:28.263512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.264289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.265337 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.265935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.327892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:28.328717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:28.335120 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.336711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.337900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.338561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.467799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:28.476139 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-011a8bc1-943c-4e03-9dfb-419871a38c29 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.231101 Feb 07 04:18:28.486471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 292/572] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:28 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:28.491470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:28.492645 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:28.501276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:28.509355 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0fcb3337-e939-4ea9-817e-1f0059673a6a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1261 microversion: 2.1 time: 0.186157 Feb 07 04:18:28.509932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 281/573] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:28 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:28.512971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.513534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.514418 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:28.514933 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:28.548888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-44e5c1f2-9363-4002-8c70-70dee43d7d85 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060984 Feb 07 04:18:28.549495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 293/574] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:28 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:18:29.284405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1612793277"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:29.284944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:29.292546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.293326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.294418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.294850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.493417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:29.494085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:29.501118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.501582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.502582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.503175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.531010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.network.security_group_api [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Adding security group 254921dc-aefe-4e71-b95d-122a6e128371 to port 8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 Feb 07 04:18:29.647927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:29.655491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6abb91e7-e585-4a61-8cb7-a9c4d1edc83c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.166807 Feb 07 04:18:29.656073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 294/575] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:29 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:29.660508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:29.661343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:29.667063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.667453 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.668275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.669569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.819364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:29.828967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-dcaa8634-ff65-4e38-9307-392ee3d57d4f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1444 microversion: 2.1 time: 0.171603 Feb 07 04:18:29.829783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 295/576] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:29 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:29.847182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:29.848224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:29.858135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.858836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:29.859949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:29.860430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.004873 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:30.012599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-be062d25-936d-48f5-b0a7-c67bd38404f1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1444 microversion: 2.1 time: 0.169504 Feb 07 04:18:30.013172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 296/577] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:29 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:30.085613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-56092820-aedd-481b-9438-02845a6ef0ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/action" status: 202 len: 0 microversion: 2.1 time: 0.806126 Feb 07 04:18:30.096965 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:30.100250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 282/578] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:18:29 2022] POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:18:30.106699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-be3367f7-a720-42a9-96ec-95ee8cf88d2c req-9c29c7c2-744f-4059-af73-94358d0f02bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:30.107890 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:30.114222 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:30.114222 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:30.119041 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.119520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.120382 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.122734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.132290 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-be3367f7-a720-42a9-96ec-95ee8cf88d2c req-9c29c7c2-744f-4059-af73-94358d0f02bf service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.133510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-be3367f7-a720-42a9-96ec-95ee8cf88d2c req-9c29c7c2-744f-4059-af73-94358d0f02bf service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.147922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-be3367f7-a720-42a9-96ec-95ee8cf88d2c req-9c29c7c2-744f-4059-af73-94358d0f02bf service nova] Creating event network-changed:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:18:30.154262 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-be3367f7-a720-42a9-96ec-95ee8cf88d2c req-9c29c7c2-744f-4059-af73-94358d0f02bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051046 Feb 07 04:18:30.154967 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 283/579] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:30.421898 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:30.429932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d7a6f33a-2642-4e16-bd25-76e1a8e2833d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1760 microversion: 2.1 time: 0.338386 Feb 07 04:18:30.430880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 297/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:30 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1760 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:30.674808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:30.675512 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:30.683439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.684550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.685382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.685817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.910707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:30.919167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5c61a662-3b48-4009-a2db-31142544a2ef tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.249505 Feb 07 04:18:30.920357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 284/581] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:30 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:30.933248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:30.933743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:30.939551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.939999 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.940815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:30.941250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:30.970632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:18:31.052304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-52797200-7119-448e-ade0-9a4c9c211254 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 204 len: 0 microversion: 2.1 time: 0.122149 Feb 07 04:18:31.052823 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 298/582] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:18:30 2022] DELETE /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 07 04:18:31.062555 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:31.064034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:31.070758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:31.071264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:31.072437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:31.072862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:31.226972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:31.235707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cd1c2e98-9c22-4aa4-b651-e42071ae9fee tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.178460 Feb 07 04:18:31.243582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 285/583] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:31 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:31.899991 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-a160e23a-c0ea-4439-8cb2-f33e18281915 req-fd07ce39-9533-4d8c-a84c-c71974f6a75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443b0913-1482-440f-b9e3-1fb5e8012d94", "tag": "17109406-6d8f-40f6-9417-ddb7abe58df8"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:31.900784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:31.900784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:31.908709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-a160e23a-c0ea-4439-8cb2-f33e18281915 req-fd07ce39-9533-4d8c-a84c-c71974f6a75f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:31.909210 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-a160e23a-c0ea-4439-8cb2-f33e18281915 req-fd07ce39-9533-4d8c-a84c-c71974f6a75f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:31.920598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-a160e23a-c0ea-4439-8cb2-f33e18281915 req-fd07ce39-9533-4d8c-a84c-c71974f6a75f service nova] Creating event network-changed:17109406-6d8f-40f6-9417-ddb7abe58df8 for instance 443b0913-1482-440f-b9e3-1fb5e8012d94 on hv-cinder-79963 Feb 07 04:18:31.925280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-a160e23a-c0ea-4439-8cb2-f33e18281915 req-fd07ce39-9533-4d8c-a84c-c71974f6a75f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030536 Feb 07 04:18:31.925863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 299/584] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:31.935985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:31.936700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:31.943059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:31.943588 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:31.944486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:31.945098 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:32.110749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:32.118112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-78c7366e-8731-42b0-adfa-9cd780c7d648 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.186370 Feb 07 04:18:32.118768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 286/585] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:31 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:32.253813 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:32.254523 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:32.261524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:32.261975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:32.262929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:32.263379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:32.407339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:32.414915 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-72e1aed3-c5a4-44d5-8070-ee00ed7b4ab7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.165171 Feb 07 04:18:32.415676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 300/586] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:32 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:33.134452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:33.135186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:33.141762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:33.142209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:33.143076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:33.143505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:33.285078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:33.292352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9d11d424-b854-4508-b59c-fd588d967173 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.161488 Feb 07 04:18:33.292924 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 287/587] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:33 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:33.430411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:33.431044 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:33.437343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:33.437789 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:33.438560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:33.438992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:33.573475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:33.581606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9e98c3de-80a4-4f1b-9630-fa56f2c2fe21 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.154820 Feb 07 04:18:33.582178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 301/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:33 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:34.310129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:34.310669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:34.316888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:34.317345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:34.318131 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:34.318576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:34.459872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:34.467416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bd993049-e301-4178-87ce-b40f4c4c5623 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1267 microversion: 2.1 time: 0.161573 Feb 07 04:18:34.468109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 288/589] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:34 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:34.597035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:34.597558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:34.603665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:34.604138 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:34.604918 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:34.605347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:34.736679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:34.743730 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c0649b52-f5c0-4eb5-85e6-3a7ac9b02baa tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.150406 Feb 07 04:18:34.744319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 302/590] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:34 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:35.484879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:35.485485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:35.491662 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:35.492145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:35.492919 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:35.493356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:35.622444 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:35.629573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2d136b15-d9e8-43d4-9e25-da4002d44240 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1455 microversion: 2.1 time: 0.148866 Feb 07 04:18:35.630165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 289/591] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:35 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:35.646082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:35.646713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:35.653230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:35.653680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:35.654451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:35.654884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:35.762135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:35.762774 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:35.769119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:35.769568 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:35.770351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:35.770786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:35.787376 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:35.795179 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b9a4f947-b4be-4e0c-a1a8-b17b58a89364 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1455 microversion: 2.1 time: 0.152808 Feb 07 04:18:35.795742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 303/592] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:35 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:35.907788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:35.915332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c2b97bde-b676-4dc2-b094-f95acce1ff9b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.157815 Feb 07 04:18:35.915898 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 290/593] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:35 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:36.931424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:36.932035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:36.938100 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:36.938527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:36.939302 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:36.939734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:37.184177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:37.191821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9bc3ee7b-0909-44a1-8e4d-5228012eaea4 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.263843 Feb 07 04:18:37.192632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 304/594] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:36 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:37.680221 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-f6fddb31-aba8-4796-9bc8-33b5a21cb995 req-f76bcb59-4f1c-4df8-a624-5ce5bd2629d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167dea27-bb6f-4570-bce1-655c26a20dbd", "tag": "d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:37.682674 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:37.682674 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:37.691337 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-f6fddb31-aba8-4796-9bc8-33b5a21cb995 req-f76bcb59-4f1c-4df8-a624-5ce5bd2629d7 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:37.691786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-f6fddb31-aba8-4796-9bc8-33b5a21cb995 req-f76bcb59-4f1c-4df8-a624-5ce5bd2629d7 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:37.703604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-f6fddb31-aba8-4796-9bc8-33b5a21cb995 req-f76bcb59-4f1c-4df8-a624-5ce5bd2629d7 service nova] Creating event network-changed:d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b for instance 167dea27-bb6f-4570-bce1-655c26a20dbd on hv-cinder-79963 Feb 07 04:18:37.708784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-f6fddb31-aba8-4796-9bc8-33b5a21cb995 req-f76bcb59-4f1c-4df8-a624-5ce5bd2629d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035558 Feb 07 04:18:37.709412 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 291/595] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:38.208764 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:38.210121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:38.218113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.218850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.219912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.220449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.386622 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:38.394311 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-95c686d7-1f42-419f-8059-5f11e02f9595 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1507 microversion: 2.1 time: 0.189073 Feb 07 04:18:38.395487 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 305/596] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:38 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:38.770895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:38.771581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:38.778563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.779096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.779989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.780521 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.865686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lazy-loading 'services' on Instance uuid 73db778d-755d-49b4-b51b-0557e2b15b37 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:18:38.928827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-189d2c68-cf27-4560-9794-3fa2c981c976 req-81f22a63-bf95-4ff9-9dd7-0418bb0d1709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a", "name": "network-vif-deleted", "tag": "e1dbf142-1764-4037-8714-29d34864f234"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:38.930392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:38.930392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:38.948156 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-12b8305e-430a-4f79-97b3-a9d506854359 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments/832594ab-e7cc-47da-928e-30c47e6b3cd8" status: 202 len: 0 microversion: 2.1 time: 0.181418 Feb 07 04:18:38.948899 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 292/597] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:18:38 2022] DELETE /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments/832594ab-e7cc-47da-928e-30c47e6b3cd8 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:18:38.952535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-189d2c68-cf27-4560-9794-3fa2c981c976 req-81f22a63-bf95-4ff9-9dd7-0418bb0d1709 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.954885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-189d2c68-cf27-4560-9794-3fa2c981c976 req-81f22a63-bf95-4ff9-9dd7-0418bb0d1709 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.961409 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:38.965225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:38.974092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.975091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.975229 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-189d2c68-cf27-4560-9794-3fa2c981c976 req-81f22a63-bf95-4ff9-9dd7-0418bb0d1709 service nova] Creating event network-vif-deleted:e1dbf142-1764-4037-8714-29d34864f234 for instance 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a on hv-cinder-79963 Feb 07 04:18:38.976731 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:38.977526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:38.980845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-189d2c68-cf27-4560-9794-3fa2c981c976 req-81f22a63-bf95-4ff9-9dd7-0418bb0d1709 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055528 Feb 07 04:18:38.981821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 306/598] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:39.016862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4e695ca9-8dc4-47f9-8f92-019d626070bd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062262 Feb 07 04:18:39.017432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 293/599] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:38 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:39.412296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:39.412993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:39.419069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:39.419455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:39.420269 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:39.420709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:39.449305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:39.450256 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:39.450701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lazy-loading 'fault' on Instance uuid 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:18:39.498916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:39.506200 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b964425a-ad72-41a0-85de-9b644881c133 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 200 len: 1312 microversion: 2.1 time: 0.098366 Feb 07 04:18:39.506758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 307/600] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:39 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:40.028563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:40.029509 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:40.035678 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.036162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.036940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.037375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.067458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a5802447-02c6-45c4-95f8-34f529c6c45a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042868 Feb 07 04:18:40.068015 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 294/601] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:40 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:40.525040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:40.525653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:40.535112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.535570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.536405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.536848 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.551516 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] HTTP exception thrown: Instance 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a could not be found. Feb 07 04:18:40.552077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Returning 404 to user: Instance 9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:18:40.553172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5ee980da-ee11-4634-a7bf-6a9d78beae0b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a" status: 404 len: 111 microversion: 2.1 time: 0.031755 Feb 07 04:18:40.553904 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 308/602] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:40 2022] GET /compute/v2.1/servers/9bac8ecd-a423-4b15-9ff7-dfcb2fd0063a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 07 04:18:40.561655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:40.562153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:40.568084 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.568544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.569323 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.569758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.593743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:18:40.673562 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e00c4936-88b2-4f17-a7d7-eb7e59f2e384 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 204 len: 0 microversion: 2.1 time: 0.115276 Feb 07 04:18:40.674144 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 295/603] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:18:40 2022] DELETE /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:18:40.681900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:40.682520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:40.688868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.689322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.690202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:40.690641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:40.829572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:40.837970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e677156b-e3b8-433d-b14d-7e0edc9bd13b tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.159646 Feb 07 04:18:40.838656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 309/604] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:40 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:41.079785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:41.080747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:41.087059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:41.087503 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:41.088315 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:41.088744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:41.116130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c179bfef-78d6-49a5-acfd-440af57adefd tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040546 Feb 07 04:18:41.116666 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 296/605] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:18:41 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:18:41.856842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:41.857610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:41.863656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:41.864134 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:41.864908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:41.865343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:41.997896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:42.005220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f064f38b-a6bc-4d1e-a544-1b59e3933cb7 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.152695 Feb 07 04:18:42.005782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 310/606] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:41 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:42.300532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:42.301066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:42.307268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.307713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.308517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.308955 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.333412 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:18:42.410188 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3257dab5-65dd-46d6-8ba3-de786b672823 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 204 len: 0 microversion: 2.1 time: 0.112940 Feb 07 04:18:42.410999 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 297/607] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:18:42 2022] DELETE /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:18:42.421364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:42.421972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:42.427695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.428168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.428936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.429364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.567403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:42.567977 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:42.568701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:42.575044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.575392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-63483612-2d72-4ac6-8a73-40b92a9b153a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1513 microversion: 2.1 time: 0.157617 Feb 07 04:18:42.575514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.575949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 311/608] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:42 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:42.576303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.576738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.598894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lazy-loading 'flavor' on Instance uuid 09f8629b-adac-41b3-a311-37fc873a7a29 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:18:42.852365 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-baf83aa4-14f0-440b-a3d0-7424d50211f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/action" status: 202 len: 0 microversion: 2.20 time: 0.288225 Feb 07 04:18:42.852985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 298/609] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Feb 7 04:18:42 2022] POST /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 07 04:18:42.861554 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:42.862159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:42.868718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.869166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:42.869933 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:42.870367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:43.016512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:43.022685 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:43.023391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:43.024257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:43.025747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:43.026882 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7a452757-290a-4d5b-8f11-be5adba33e0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.169063 Feb 07 04:18:43.027430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 312/610] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:42 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:43.030163 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:43.030618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:43.031401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:43.031839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:43.167209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:43.174408 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-61d0e007-1647-48d9-9dbf-97ec12343756 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.156450 Feb 07 04:18:43.174971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 299/611] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:43 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:43.592195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:43.592817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:43.598579 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:43.599025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:43.599794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:43.600254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:43.730977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:43.738178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-46c80316-2d3e-425d-aa6b-c04fcdca24a2 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1513 microversion: 2.1 time: 0.149710 Feb 07 04:18:43.738742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 313/612] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:43 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:44.045892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:44.046492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:44.053441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:44.053923 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:44.054710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:44.055145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:44.182296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:44.189881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:44.190404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:44.190525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:44.191768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:44.192944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ff1f5a94-a3f1-4e69-b5f1-5353403c78e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.150700 Feb 07 04:18:44.193492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 300/613] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:44 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:44.197565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:44.198015 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:44.198794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:44.199252 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:44.327408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:44.334672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-49445130-6cb6-44a9-aa7c-e18450feb5ce tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.148390 Feb 07 04:18:44.335232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 314/614] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:44 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:44.755338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:44.755941 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:44.762797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:44.763246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:44.764011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:44.764466 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:44.897190 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:44.904788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7a5c70e1-2db9-4963-af06-ec9832336292 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1513 microversion: 2.1 time: 0.153140 Feb 07 04:18:44.905346 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 301/615] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:44 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:45.209979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:45.210587 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:45.217442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:45.217892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:45.218664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:45.219098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:45.347179 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:45.351840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:45.352475 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:45.355060 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:45.356610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:45.357798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d2c00d4d-c967-4d4c-ba15-2db5615d3ed0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.151495 Feb 07 04:18:45.358548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 315/616] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:45 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:45.359903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:45.360382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:45.361167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:45.361602 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:45.494324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:45.501882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f4a44c16-0718-4a1a-afeb-c5a07e6232db tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.153767 Feb 07 04:18:45.502437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 302/617] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:45 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:45.921949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:45.922586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:45.928649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:45.929109 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:45.929900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:45.930343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:46.063820 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:46.071297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-de4d904b-739b-4d21-a8be-8a368c20e003 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1513 microversion: 2.1 time: 0.153542 Feb 07 04:18:46.071872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 316/618] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:45 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:46.360917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-b862a810-8c8e-405f-8c26-4bf64232376d req-87c13faa-6ac9-4549-a981-53a0ebe36dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73db778d-755d-49b4-b51b-0557e2b15b37", "name": "network-vif-deleted", "tag": "ac94b66d-3a3d-43fe-82fe-267f8a81a9ea"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:46.362644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:46.362644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:46.371945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-b862a810-8c8e-405f-8c26-4bf64232376d req-87c13faa-6ac9-4549-a981-53a0ebe36dcc service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:46.372428 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-b862a810-8c8e-405f-8c26-4bf64232376d req-87c13faa-6ac9-4549-a981-53a0ebe36dcc service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:46.375629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:46.376273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:46.382104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:46.382552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:46.383320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:46.383699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-b862a810-8c8e-405f-8c26-4bf64232376d req-87c13faa-6ac9-4549-a981-53a0ebe36dcc service nova] Creating event network-vif-deleted:ac94b66d-3a3d-43fe-82fe-267f8a81a9ea for instance 73db778d-755d-49b4-b51b-0557e2b15b37 on hv-cinder-79963 Feb 07 04:18:46.383807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:46.388758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-b862a810-8c8e-405f-8c26-4bf64232376d req-87c13faa-6ac9-4549-a981-53a0ebe36dcc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031493 Feb 07 04:18:46.389462 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 303/619] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:46.519495 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:46.520226 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:46.527165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:46.527391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:46.528629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:46.529445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:46.547657 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:46.556615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:46.558230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:46.560076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ff9faf4b-6dd8-48aa-9f42-d557aacae1fe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.188110 Feb 07 04:18:46.560641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 317/620] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:46 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:18:46.680544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:46.688440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4f4f8b97-d77f-4ac0-87ef-2c5fb2ec109f tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.173568 Feb 07 04:18:46.689012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 304/621] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:46 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:47.087721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:47.088366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:47.094672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.095127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.095918 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.096380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.127645 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.128224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.128677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lazy-loading 'fault' on Instance uuid 73db778d-755d-49b4-b51b-0557e2b15b37 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:18:47.172603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:47.180363 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5e908e62-cd95-4b78-8211-5d214d2017db tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 200 len: 1307 microversion: 2.1 time: 0.096270 Feb 07 04:18:47.180930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 318/622] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:47 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:47.577860 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:47.578473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:47.584699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.585151 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.585924 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.586358 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.705287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:47.705894 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:47.712414 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.712914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.713815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:47.714328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:47.714742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:47.723162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:47.724722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:47.725863 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fe9ad080-1df8-4910-ac57-771797f3f9ab tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.152268 Feb 07 04:18:47.726557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 305/623] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:47 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:47.851054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:47.859266 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-afe0b84f-4ce8-4729-a733-42b0720daa8e tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.157476 Feb 07 04:18:47.859917 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 319/624] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:47 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:48.197264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:48.197868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 73db778d-755d-49b4-b51b-0557e2b15b37] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:48.204231 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:48.204674 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:48.205440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:48.205864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:48.219253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] HTTP exception thrown: Instance 73db778d-755d-49b4-b51b-0557e2b15b37 could not be found. Feb 07 04:18:48.219821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Returning 404 to user: Instance 73db778d-755d-49b4-b51b-0557e2b15b37 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:18:48.220633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f1b0e9f3-478a-4888-aa69-dcc6ee9e3481 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37" status: 404 len: 111 microversion: 2.1 time: 0.027074 Feb 07 04:18:48.221142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 306/625] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:48 2022] GET /compute/v2.1/servers/73db778d-755d-49b4-b51b-0557e2b15b37 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:18:48.744268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:48.744914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:48.751916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:48.752395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:48.753173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:48.753609 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:48.876480 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:48.877089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:48.883215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:48.883665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:48.884468 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:48.884907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:48.886488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:48.894675 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:48.896608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:48.897779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6a776ddc-10bd-4eff-b873-212330d13186 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.157511 Feb 07 04:18:48.898521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 320/626] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:48 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:49.027389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:49.034872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7cc7d869-f4f9-401d-b5f0-2501ef668f53 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.162049 Feb 07 04:18:49.035425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 307/627] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:48 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:49.343317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:49.343817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:49.349602 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:49.350056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:49.350835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:49.351270 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:49.375432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:18:49.446172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-376fe6f1-866e-4735-a824-677d14ed896e tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 204 len: 0 microversion: 2.1 time: 0.106698 Feb 07 04:18:49.446747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 321/628] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:18:49 2022] DELETE /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:18:49.454418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:49.455027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:49.460757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:49.461206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:49.461982 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:49.462409 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:49.593431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:49.600610 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-feb1c07c-ed6c-4339-ba04-f3472977a2d7 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1514 microversion: 2.1 time: 0.149789 Feb 07 04:18:49.601171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 308/629] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:49 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:49.916547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:49.917310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:49.926543 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:49.926984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:49.927803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:49.928295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:50.051157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:50.051771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:50.058447 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:50.058907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:50.059704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:50.060173 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:50.063721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:50.071385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:50.072919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:50.074068 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-62c9466e-3467-41b5-b50e-84d08fda3d05 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.161685 Feb 07 04:18:50.075122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 322/630] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:49 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:50.253680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949f46f3cd34ff28833d743c16b4f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9eb47ba0e1b464fac1b4fccbd4905ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:50.261397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1c0b01bb-ac6d-4073-8de7-a8fae46f1c63 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 200 len: 1520 microversion: 2.1 time: 0.213876 Feb 07 04:18:50.262001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 309/631] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:50 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:50.328724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-772835af-acd2-4ef7-92d2-3729dc64408a req-bacf645b-e2ae-4543-aa9f-07c729850241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb55652-6b90-48a0-8c34-def2934ea25d", "name": "network-vif-deleted", "tag": "08a3936d-26aa-4031-920c-7291ded7d6bc"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:50.330526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:50.330526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:50.338664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-772835af-acd2-4ef7-92d2-3729dc64408a req-bacf645b-e2ae-4543-aa9f-07c729850241 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:50.339104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-772835af-acd2-4ef7-92d2-3729dc64408a req-bacf645b-e2ae-4543-aa9f-07c729850241 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:50.350374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-772835af-acd2-4ef7-92d2-3729dc64408a req-bacf645b-e2ae-4543-aa9f-07c729850241 service nova] Creating event network-vif-deleted:08a3936d-26aa-4031-920c-7291ded7d6bc for instance 8bb55652-6b90-48a0-8c34-def2934ea25d on hv-cinder-79963 Feb 07 04:18:50.354915 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-772835af-acd2-4ef7-92d2-3729dc64408a req-bacf645b-e2ae-4543-aa9f-07c729850241 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029754 Feb 07 04:18:50.356083 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 323/632] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:50.617695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:50.618299 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:50.624761 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:50.625217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:50.625985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:50.626418 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:50.759843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:50.768281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cb789b6c-5038-40e7-a436-71e855bb4f5a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1514 microversion: 2.1 time: 0.154126 Feb 07 04:18:50.768858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 310/633] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:50 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:51.093868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:51.094488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:51.100708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:51.101243 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:51.102040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:51.102479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:51.233497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:51.241177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:51.242692 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:51.243845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e5b403fc-2fd4-4cd1-b4bf-9ef65505f4eb tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.155106 Feb 07 04:18:51.244440 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 324/634] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:51 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:51.278448 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:51.279115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] [instance: 8bb55652-6b90-48a0-8c34-def2934ea25d] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:51.285438 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:51.285891 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:51.286675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:51.287116 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:51.299989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] HTTP exception thrown: Instance 8bb55652-6b90-48a0-8c34-def2934ea25d could not be found. Feb 07 04:18:51.300594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] Returning 404 to user: Instance 8bb55652-6b90-48a0-8c34-def2934ea25d could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:18:51.301432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-18ae3253-af92-4ca4-b76d-411d7ea27046 tempest-ServerRescueNegativeTestJSON-1040366653 tempest-ServerRescueNegativeTestJSON-1040366653-project] 10.222.0.13 "GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d" status: 404 len: 111 microversion: 2.1 time: 0.027459 Feb 07 04:18:51.301956 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 311/635] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:51 2022] GET /compute/v2.1/servers/8bb55652-6b90-48a0-8c34-def2934ea25d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:18:51.785914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:51.786538 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:51.792597 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:51.793615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:51.794405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:51.794839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:52.177384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:52.184813 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-65ebe265-2b89-49cf-beaa-c36bae5d4a53 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1514 microversion: 2.1 time: 0.402584 Feb 07 04:18:52.185470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 325/636] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:51 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:52.262404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:52.262975 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:52.268875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:52.269325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:52.270101 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:52.270529 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:52.400015 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:52.408091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:52.409595 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:52.410744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4f7643fb-223f-4e8f-b7dd-388956ecf5f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.152870 Feb 07 04:18:52.411294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 312/637] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:52 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:53.201695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:53.202908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:53.210775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-f8b5fc80-ea48-45af-9cc3-118c99aa34d4 req-da72258f-feea-49ce-b748-d17bc56c996e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d93682d-b600-4636-ad86-a035be1c2500", "name": "network-vif-deleted", "tag": "14881f67-cb42-40b9-a3da-ac9deed53950"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:53.212755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:53.212755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:18:53.227474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:53.228362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:53.229380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-f8b5fc80-ea48-45af-9cc3-118c99aa34d4 req-da72258f-feea-49ce-b748-d17bc56c996e service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:53.229553 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:53.230145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-f8b5fc80-ea48-45af-9cc3-118c99aa34d4 req-da72258f-feea-49ce-b748-d17bc56c996e service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:53.232943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:53.251743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-f8b5fc80-ea48-45af-9cc3-118c99aa34d4 req-da72258f-feea-49ce-b748-d17bc56c996e service nova] Creating event network-vif-deleted:14881f67-cb42-40b9-a3da-ac9deed53950 for instance 5d93682d-b600-4636-ad86-a035be1c2500 on hv-cinder-79963 Feb 07 04:18:53.263618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-f8b5fc80-ea48-45af-9cc3-118c99aa34d4 req-da72258f-feea-49ce-b748-d17bc56c996e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056206 Feb 07 04:18:53.264865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 313/638] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:53.331197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:53.340295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a5df6b3c-8384-4a94-be70-e93b2c13a104 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 200 len: 1472 microversion: 2.1 time: 0.141852 Feb 07 04:18:53.354185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 326/639] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:53 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:53.429302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:53.430007 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:53.437309 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:53.438013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:53.438981 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:53.439675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:53.586841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:53.597682 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:53.599228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:53.601409 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-83a77b25-d58f-4ce2-b04c-6f92588986e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.176164 Feb 07 04:18:53.601970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 314/640] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:53 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:54.359354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:54.360088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 5d93682d-b600-4636-ad86-a035be1c2500] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:54.366599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.367063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.367847 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.368323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.382983 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] HTTP exception thrown: Instance 5d93682d-b600-4636-ad86-a035be1c2500 could not be found. Feb 07 04:18:54.383576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Returning 404 to user: Instance 5d93682d-b600-4636-ad86-a035be1c2500 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:18:54.384426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-81683b00-34d5-4165-8471-9c77a5719f26 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500" status: 404 len: 111 microversion: 2.1 time: 0.028772 Feb 07 04:18:54.384964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 327/641] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:54 2022] GET /compute/v2.1/servers/5d93682d-b600-4636-ad86-a035be1c2500 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:18:54.393449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:54.393976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:54.399921 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.400404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.401179 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.401614 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.426263 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:18:54.503093 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-09a69f64-063d-4010-a20e-d9fa25aefa93 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 204 len: 0 microversion: 2.1 time: 0.113012 Feb 07 04:18:54.503993 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 315/642] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:18:54 2022] DELETE /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 07 04:18:54.514338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:54.515292 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:54.521851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.522559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.523567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.524213 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.620225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:54.621525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:54.627526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.627972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.629024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:54.629613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:54.779743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:54.797993 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:54.799604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:54.802183 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cdc77afc-7db1-4304-b87f-dcd789d6d793 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.185374 Feb 07 04:18:54.802830 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 316/643] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:54 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:18:54.828870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:54.839094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-24b11ef8-d69d-4231-876e-13aecec496e6 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1514 microversion: 2.1 time: 0.330909 Feb 07 04:18:54.839714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 328/644] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:54 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:55.824779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:55.825338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:55.831239 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:55.831588 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:55.832440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:55.832885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:55.980950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5c21bfa5-e745-4371-ad9b-d41ad28d269e tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Action: 'create', calling method: .version_select at 0x7f917b3351f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-298742612"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:55.981416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:55.988939 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:55.990424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:55.991640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cced21b8-4149-4413-bc4f-05c1432c173d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.175210 Feb 07 04:18:55.992208 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 317/645] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:55 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:55.996991 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:55.997581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:56.003687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:56.004146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:56.004937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:56.005387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:56.137066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:56.144650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2b900a91-2ec5-4786-b186-72adcd88cf95 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1514 microversion: 2.1 time: 0.151436 Feb 07 04:18:56.145284 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 318/646] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:55 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:18:56.260697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5c21bfa5-e745-4371-ad9b-d41ad28d269e tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.437939 Feb 07 04:18:56.261320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 329/647] 10.222.0.13 () {60 vars in 1154 bytes} [Mon Feb 7 04:18:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 07 04:18:56.271627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-186ff5e9-f7d6-4936-ab13-1e43e7328f2e tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b43d820>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:56.318693 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-186ff5e9-f7d6-4936-ab13-1e43e7328f2e tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 200 len: 344 microversion: 2.1 time: 0.050572 Feb 07 04:18:56.319289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 319/648] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:18:56 2022] GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:57.010577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:57.011192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:57.018485 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:57.018941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:57.019715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:57.020191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:57.152126 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:57.160459 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:57.161993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:57.162835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:57.163303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-74757ace-fb56-4d0b-8931-aa254b5eaa76 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.156744 Feb 07 04:18:57.163460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:57.163671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 330/649] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:57 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:57.169816 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:57.170265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:57.171037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:57.171470 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:57.313176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:57.320442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8af0cfc8-a7be-4ca3-8b31-3a2b7312bf8f tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1514 microversion: 2.1 time: 0.161658 Feb 07 04:18:57.321009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 320/650] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:57 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:57.330807 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-60d394de-aa40-43bb-a50b-92a4e83e2fde tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b2f2040>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:57.378323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-60d394de-aa40-43bb-a50b-92a4e83e2fde tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 200 len: 344 microversion: 2.1 time: 0.051471 Feb 07 04:18:57.378883 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 331/651] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:18:57 2022] GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:58.181265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:58.181883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:58.188145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:58.188608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:58.189394 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:58.189835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:58.337474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:58.338004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:58.343678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:58.344335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:58.345116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:58.345845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:58.392443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:58.400383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:58.401740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:58.403296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-36412ecb-5e88-4fea-b44a-1f70a57377e6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.225904 Feb 07 04:18:58.403859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 321/652] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:58 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:58.408805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:58.409119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-398b27c7-a1cd-415d-9120-66151f37074c tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b34ad30>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:58.418874 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a764da53-7ebd-455c-a06c-858538c6c0cb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 200 len: 1472 microversion: 2.1 time: 0.085497 Feb 07 04:18:58.419780 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 332/653] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:58 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:18:58.477654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-398b27c7-a1cd-415d-9120-66151f37074c tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 200 len: 345 microversion: 2.1 time: 0.072530 Feb 07 04:18:58.478514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 322/654] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:18:58 2022] GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:58.481961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-df97981d-261f-4c63-9c77-4cfc1ca6a343 req-1ad30aca-15ba-4e09-b608-2ed217f623a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c530ca-8978-4f69-b360-974e35d97a0c", "name": "network-vif-deleted", "tag": "e4368539-c55d-4781-9c7f-7915272fcb88"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:58.483841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:18:58.483841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:18:58.490080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-73491662-0068-4af4-b4f2-b005e52da251 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Action: 'create', calling method: .version_select at 0x7f917b387790>, body: {"snapshot": {"volume_id": "ca711cda-bda3-4bb3-ac89-77cfecfe11b6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1639152932"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:18:58.493671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-df97981d-261f-4c63-9c77-4cfc1ca6a343 req-1ad30aca-15ba-4e09-b608-2ed217f623a8 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:58.494122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-df97981d-261f-4c63-9c77-4cfc1ca6a343 req-1ad30aca-15ba-4e09-b608-2ed217f623a8 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:58.507190 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-df97981d-261f-4c63-9c77-4cfc1ca6a343 req-1ad30aca-15ba-4e09-b608-2ed217f623a8 service nova] Creating event network-vif-deleted:e4368539-c55d-4781-9c7f-7915272fcb88 for instance b7c530ca-8978-4f69-b360-974e35d97a0c on hv-cinder-79963 Feb 07 04:18:58.514507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-df97981d-261f-4c63-9c77-4cfc1ca6a343 req-1ad30aca-15ba-4e09-b608-2ed217f623a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Feb 07 04:18:58.515875 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 333/655] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:58.653417 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-73491662-0068-4af4-b4f2-b005e52da251 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.167048 Feb 07 04:18:58.654137 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 323/656] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Feb 7 04:18:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:18:58.669566 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b6f294a3-d323-4cc1-8b7b-94ea5a5c436f tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b4e1b80>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:58.705449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b6f294a3-d323-4cc1-8b7b-94ea5a5c436f tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.042837 Feb 07 04:18:58.706117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 334/657] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:18:58 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:58.715533 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-719a74ef-eb35-45bd-b341-cd056495e6aa tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b429ee0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:58.756184 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-719a74ef-eb35-45bd-b341-cd056495e6aa tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044174 Feb 07 04:18:58.756767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 324/658] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Feb 7 04:18:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:58.766465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4561e976-cbf1-40ec-a966-49f53d931bcf tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b2b41f0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:58.794099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4561e976-cbf1-40ec-a966-49f53d931bcf tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.031168 Feb 07 04:18:58.794637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 335/659] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:18:58 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:18:59.421675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:59.422321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:59.428300 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:59.428756 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:59.429799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:59.430242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:59.434948 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:59.435670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: b7c530ca-8978-4f69-b360-974e35d97a0c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:18:59.442059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:59.442504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:59.443271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:18:59.443702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:18:59.457066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] HTTP exception thrown: Instance b7c530ca-8978-4f69-b360-974e35d97a0c could not be found. Feb 07 04:18:59.457663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Returning 404 to user: Instance b7c530ca-8978-4f69-b360-974e35d97a0c could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:18:59.458489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5fe5e0c2-dcef-4a55-ab6c-b7521f8f8c1a tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c" status: 404 len: 111 microversion: 2.1 time: 0.027881 Feb 07 04:18:59.459034 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 336/660] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:18:59 2022] GET /compute/v2.1/servers/b7c530ca-8978-4f69-b360-974e35d97a0c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 07 04:18:59.566302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:59.574505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:59.576010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:18:59.577183 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-57dae983-c2b9-4e79-a46e-e53fa5b57bfd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.159719 Feb 07 04:18:59.577738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 325/661] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:18:59 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:18:59.805425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-76ec5584-30fe-41a4-a06c-8d0d69191525 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b46d820>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:18:59.833796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-76ec5584-30fe-41a4-a06c-8d0d69191525 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.031974 Feb 07 04:18:59.834347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 337/662] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:18:59 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:00.595349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:00.595979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:00.602264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:00.602708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:00.603479 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:00.603909 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:00.732264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:00.739844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:00.741362 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:00.742525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d9eb343f-8120-4048-8a76-fb08a1b334c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.150908 Feb 07 04:19:00.743082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 326/663] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:00 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:00.846386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-afd52d58-aee1-492f-b855-d2457fe62108 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b2f20d0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:00.874490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-afd52d58-aee1-492f-b855-d2457fe62108 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.032376 Feb 07 04:19:00.875041 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 338/664] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:19:00 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:01.760367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:01.760983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:01.767355 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:01.767806 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:01.768675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:01.769115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:01.886479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7d3bd285-e3f4-4d5f-a2b7-0fe64945bb97 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b3351f0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:01.908019 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:01.914928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7d3bd285-e3f4-4d5f-a2b7-0fe64945bb97 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.032589 Feb 07 04:19:01.915492 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 339/665] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:19:01 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:19:01.915833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:01.917373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:01.919020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b9bcbf19-1dac-4c34-a286-7ad7ed2423a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.162373 Feb 07 04:19:01.919564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 327/666] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:01 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:02.927048 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-eed11818-729e-4ca8-9fbf-a2168210f0e0 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b32cb80>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:02.936872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:02.938016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:02.944731 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:02.945377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:02.946159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:02.946591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:02.955795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-eed11818-729e-4ca8-9fbf-a2168210f0e0 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.032897 Feb 07 04:19:02.956388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 340/667] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:19:02 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:03.079411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:03.087336 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:03.088725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:03.090366 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-50278fe1-d759-401f-9263-663d3ebc437c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.157376 Feb 07 04:19:03.090920 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 328/668] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:02 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:03.966924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-087540d1-6e9c-4a98-be4b-0fd84f064ed8 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b25f040>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:03.994676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-087540d1-6e9c-4a98-be4b-0fd84f064ed8 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 288 microversion: 2.1 time: 0.031799 Feb 07 04:19:03.995211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 341/669] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:19:03 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 288 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:19:04.005472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-01ec6c78-a4c1-4af8-bb72-562190cf0c3d tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b43db80>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:04.063060 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-01ec6c78-a4c1-4af8-bb72-562190cf0c3d tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 202 len: 0 microversion: 2.1 time: 0.061103 Feb 07 04:19:04.063624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 329/670] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Feb 7 04:19:04 2022] DELETE /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:19:04.071902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a3d8c2be-4097-4b1f-bd81-1c2f0ed5bae2 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b2ad1f0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:04.099365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a3d8c2be-4097-4b1f-bd81-1c2f0ed5bae2 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 200 len: 287 microversion: 2.1 time: 0.031133 Feb 07 04:19:04.099928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 342/671] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:19:04 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:04.108627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:04.109236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:04.115145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:04.115601 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:04.116403 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:04.116841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:04.454626 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:04.466783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:04.468309 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:04.469469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b3d2b684-b4cb-489d-a476-effb819070ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.365124 Feb 07 04:19:04.470032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 330/672] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:04 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:04.768891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:04.769386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:04.775194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:04.775633 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:04.776433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:04.777729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:04.805059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:19:04.879095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-06429a4d-99d4-4757-a067-319ca1fcfdbf tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 204 len: 0 microversion: 2.1 time: 0.113495 Feb 07 04:19:04.879827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 343/673] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:19:04 2022] DELETE /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:19:04.888604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:04.889302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:04.895110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:04.895562 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:04.896370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:04.896808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:05.027800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:05.035126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-efc9fee7-3d6b-4839-925a-a055a561d8eb tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1515 microversion: 2.1 time: 0.150929 Feb 07 04:19:05.035694 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 331/674] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:19:04 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:19:05.111583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-651a97fd-eaab-4fc7-abd9-54ecbe089ef6 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b2addc0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:05.134914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-651a97fd-eaab-4fc7-abd9-54ecbe089ef6 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] HTTP exception thrown: Snapshot af004687-02c1-478a-ad53-a0c94f846d0a could not be found. Feb 07 04:19:05.135534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-651a97fd-eaab-4fc7-abd9-54ecbe089ef6 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Returning 404 to user: Snapshot af004687-02c1-478a-ad53-a0c94f846d0a could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:19:05.136383 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-651a97fd-eaab-4fc7-abd9-54ecbe089ef6 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a" status: 404 len: 111 microversion: 2.1 time: 0.028875 Feb 07 04:19:05.136903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 344/675] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Feb 7 04:19:05 2022] GET /compute/v2.1/os-snapshots/af004687-02c1-478a-ad53-a0c94f846d0a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:19:05.144782 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-12ee82e8-91f0-4752-984e-283030a877a9 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b34a310>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:05.200616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-12ee82e8-91f0-4752-984e-283030a877a9 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 202 len: 0 microversion: 2.1 time: 0.059414 Feb 07 04:19:05.201344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 332/676] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Feb 7 04:19:05 2022] DELETE /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:19:05.209805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-43f11f0f-e353-4875-a3ef-5937917b10c0 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f9181202dc0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:05.258079 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-43f11f0f-e353-4875-a3ef-5937917b10c0 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 200 len: 344 microversion: 2.1 time: 0.052612 Feb 07 04:19:05.258632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 345/677] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:19:05 2022] GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:05.490590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:05.491203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:05.496971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:05.497423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:05.498197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:05.498633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:05.632454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:05.640715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:05.642221 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:05.643356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0c3c52a8-a556-4827-afbf-3394fa7755da tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.156525 Feb 07 04:19:05.643907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 333/678] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:05 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:06.051681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:06.052431 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:06.058891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:06.059344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:06.060145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:06.060583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:06.193399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:06.200651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-729e2301-69ea-4917-9bc6-88dc2f0c19ad tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1515 microversion: 2.1 time: 0.152699 Feb 07 04:19:06.201208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 346/679] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:19:06 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:19:06.269801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-90531473-0651-4894-8720-272860edaabe tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b30bee0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:06.295783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-90531473-0651-4894-8720-272860edaabe tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] HTTP exception thrown: Volume ca711cda-bda3-4bb3-ac89-77cfecfe11b6 could not be found. Feb 07 04:19:06.296403 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-90531473-0651-4894-8720-272860edaabe tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Returning 404 to user: Volume ca711cda-bda3-4bb3-ac89-77cfecfe11b6 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:19:06.297218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-90531473-0651-4894-8720-272860edaabe tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 404 len: 109 microversion: 2.1 time: 0.031199 Feb 07 04:19:06.297747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 334/680] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:19:06 2022] GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:19:06.311564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-036069a8-c245-401d-89fc-85bc650b5bdc tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b474f70>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:06.337618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-036069a8-c245-401d-89fc-85bc650b5bdc tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] HTTP exception thrown: Volume ca711cda-bda3-4bb3-ac89-77cfecfe11b6 could not be found. Feb 07 04:19:06.338208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-036069a8-c245-401d-89fc-85bc650b5bdc tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Returning 404 to user: Volume ca711cda-bda3-4bb3-ac89-77cfecfe11b6 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:19:06.339021 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-036069a8-c245-401d-89fc-85bc650b5bdc tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 404 len: 109 microversion: 2.1 time: 0.031758 Feb 07 04:19:06.339557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 347/681] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Feb 7 04:19:06 2022] DELETE /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:19:06.347076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dd2e6540-df68-493d-ba27-6699c2051640 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Calling method '.version_select at 0x7f917b3aeaf0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:06.373892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-dd2e6540-df68-493d-ba27-6699c2051640 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] HTTP exception thrown: Volume ca711cda-bda3-4bb3-ac89-77cfecfe11b6 could not be found. Feb 07 04:19:06.374508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dd2e6540-df68-493d-ba27-6699c2051640 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] Returning 404 to user: Volume ca711cda-bda3-4bb3-ac89-77cfecfe11b6 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:19:06.375327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dd2e6540-df68-493d-ba27-6699c2051640 tempest-VolumesSnapshotsTestJSON-105030485 tempest-VolumesSnapshotsTestJSON-105030485-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6" status: 404 len: 109 microversion: 2.1 time: 0.031861 Feb 07 04:19:06.375850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 335/682] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Feb 7 04:19:06 2022] GET /compute/v2.1/os-volumes/ca711cda-bda3-4bb3-ac89-77cfecfe11b6 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 07 04:19:06.662287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:06.662939 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:06.670156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:06.670671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:06.671470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:06.671912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:06.860562 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:06.868698 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:06.870199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:06.871396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-67fe1ff1-56b3-40c1-a71a-b91269a6b69f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.212833 Feb 07 04:19:06.871951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 348/683] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:06 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:07.220982 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:07.221609 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:07.227630 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:07.228124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:07.228944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:07.229385 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:07.381168 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:07.389249 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-64129676-3f32-4056-8e8d-4faff5ca0784 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1515 microversion: 2.1 time: 0.176449 Feb 07 04:19:07.389812 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 336/684] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:19:07 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:19:07.890519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:07.891152 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:07.903648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:07.904490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:07.905388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:07.905827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:08.066195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:08.075214 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:08.078788 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:08.081182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8f1f29f2-8e11-4805-8e27-544285eaec25 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.195004 Feb 07 04:19:08.082134 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 349/685] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:07 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:08.406659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:08.407979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:08.414619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:08.415081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:08.415868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:08.416464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:08.633036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4bef2b813144fab2053b3547694bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d109aa9a364bed8b25935d5374bf3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:08.641828 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-008841bf-5647-453f-9db3-f979ea7ccef0 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 200 len: 1515 microversion: 2.1 time: 0.239600 Feb 07 04:19:08.642462 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 337/686] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:19:08 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:19:08.778598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-3349d322-4195-4e32-a9de-a8e314872760 req-96a4f150-ca7f-4c85-b37d-ee0f77cd0f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ab83aa-0797-44a0-b215-5bfdf13708e8", "name": "network-vif-deleted", "tag": "7316a72a-35b8-43ff-990d-60cf1f6bb7d6"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:19:08.780885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:19:08.780885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:19:08.789799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-3349d322-4195-4e32-a9de-a8e314872760 req-96a4f150-ca7f-4c85-b37d-ee0f77cd0f04 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:08.790244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-3349d322-4195-4e32-a9de-a8e314872760 req-96a4f150-ca7f-4c85-b37d-ee0f77cd0f04 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:08.802022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-3349d322-4195-4e32-a9de-a8e314872760 req-96a4f150-ca7f-4c85-b37d-ee0f77cd0f04 service nova] Creating event network-vif-deleted:7316a72a-35b8-43ff-990d-60cf1f6bb7d6 for instance 31ab83aa-0797-44a0-b215-5bfdf13708e8 on hv-cinder-79963 Feb 07 04:19:08.807688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-3349d322-4195-4e32-a9de-a8e314872760 req-96a4f150-ca7f-4c85-b37d-ee0f77cd0f04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032840 Feb 07 04:19:08.809219 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 350/687] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:09.100290 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:09.100928 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:09.108090 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:09.108522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:09.109319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:09.109773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:09.287334 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:09.297424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:09.299643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:09.301344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8e052625-d33f-4446-9369-6816413aa03e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.204925 Feb 07 04:19:09.305335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-155b0c81-7189-4cc4-a2bb-902b39f1cc48 req-4b22c4f2-363a-4e3b-9ed5-0c3b94c3cbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "name": "network-vif-plugged", "status": "completed", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:19:09.307441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:19:09.307441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:19:09.313217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 338/688] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:09 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:09.317258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-155b0c81-7189-4cc4-a2bb-902b39f1cc48 req-4b22c4f2-363a-4e3b-9ed5-0c3b94c3cbfe service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:09.318016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-155b0c81-7189-4cc4-a2bb-902b39f1cc48 req-4b22c4f2-363a-4e3b-9ed5-0c3b94c3cbfe service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:09.333901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-155b0c81-7189-4cc4-a2bb-902b39f1cc48 req-4b22c4f2-363a-4e3b-9ed5-0c3b94c3cbfe service nova] Creating event network-vif-plugged:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:19:09.339925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-155b0c81-7189-4cc4-a2bb-902b39f1cc48 req-4b22c4f2-363a-4e3b-9ed5-0c3b94c3cbfe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037996 Feb 07 04:19:09.341405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 351/689] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:19:09.658661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:09.659888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] [instance: 31ab83aa-0797-44a0-b215-5bfdf13708e8] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:09.665650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:09.666176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:09.667069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:09.668755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:09.681433 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] HTTP exception thrown: Instance 31ab83aa-0797-44a0-b215-5bfdf13708e8 could not be found. Feb 07 04:19:09.682111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] Returning 404 to user: Instance 31ab83aa-0797-44a0-b215-5bfdf13708e8 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:19:09.683041 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-54583d2f-3ce6-465f-8822-fdecbc2c9fc8 tempest-AttachVolumeNegativeTest-57378880 tempest-AttachVolumeNegativeTest-57378880-project] 10.222.0.13 "GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8" status: 404 len: 111 microversion: 2.1 time: 0.027986 Feb 07 04:19:09.683665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 339/690] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:19:09 2022] GET /compute/v2.1/servers/31ab83aa-0797-44a0-b215-5bfdf13708e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:19:10.319932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:10.320679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:10.327842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:10.328326 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:10.329146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:10.329583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:10.501507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:10.509296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:10.510823 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:10.512061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4895aa81-f268-45ee-9265-341a82380a27 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.196445 Feb 07 04:19:10.512623 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 352/691] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:10 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:11.530783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:11.531481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:11.537906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:11.538460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:11.539325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:11.539843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:11.695158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:11.712556 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:11.714952 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:11.716306 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-574a6d01-5c69-4978-8dd8-37d3744cde8f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.189987 Feb 07 04:19:11.726837 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 340/692] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:11 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:12.733969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:12.735116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:12.742313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:12.742761 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:12.743545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:12.743979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:12.900690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:12.909826 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:12.911380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:12.912565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-92f7cc36-41b8-47c2-8983-3beee32a276c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.182835 Feb 07 04:19:12.913124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 353/693] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:12 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:13.930126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:13.930740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:13.936885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:13.937338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:13.938150 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:13.938583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:14.077153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:14.086269 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:14.087824 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:14.089220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-64c7ca7d-c338-4d2f-a912-19327f94df10 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1746 microversion: 2.20 time: 0.162633 Feb 07 04:19:14.089764 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 341/694] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:13 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:15.109427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:15.111371 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:15.127067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:15.127766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:15.128754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:15.129344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:15.340454 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:15.349299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:15.351173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:15.352454 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-52e33f30-8c8f-482f-ab8a-42d33e66b3d9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.249322 Feb 07 04:19:15.353224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 354/695] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:15 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:16.379420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:16.380281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:16.396022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:16.398021 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:16.400378 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:16.402229 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:16.624985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:16.640084 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:16.641734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:16.642995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f1b27425-d2f5-4d0c-a616-1671999ef60c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.270451 Feb 07 04:19:16.644115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 342/696] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:16 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:17.662457 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:17.663720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:17.671496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:17.672374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:17.673395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:17.673930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:17.846667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:17.855610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:17.857936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:17.859561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-92f774bb-86c6-4772-9100-ece0561d872d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.201017 Feb 07 04:19:17.860627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 355/697] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:17 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:18.878557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:18.879381 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:18.887049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:18.887762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:18.888708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:18.889320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:19.043514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:19.051576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:19.053657 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:19.055237 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-66fbb5ca-92fa-4b94-a004-6614e4bd7b12 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.180352 Feb 07 04:19:19.055790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 343/698] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:18 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:19:20.078249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:20.079835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:20.086995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:20.087462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:20.088308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:20.088742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:20.244430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:20.252891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:20.254736 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:20.256128 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a83684f6-ae80-4fd6-8d62-e7eed38ccb3e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.185519 Feb 07 04:19:20.256686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 356/699] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:20 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:21.278859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:21.280005 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:21.287293 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:21.287835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:21.288882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:21.289870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:21.444752 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:21.457020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:21.457020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:21.457020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-83d3126e-9d8b-4d3d-9b00-4cd7e6df08ff tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.186512 Feb 07 04:19:21.458405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 344/700] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:21 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:22.475199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:22.476925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:22.484076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:22.485033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:22.486595 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:22.487250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:22.652116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:22.661235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:22.662754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:22.664129 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c1c71ffb-a2ba-4773-b1a8-1fb99230f05a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.193204 Feb 07 04:19:22.674974 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 357/701] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:22 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:23.683177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:23.684269 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:23.713489 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:23.714655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:23.715586 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:23.716256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:23.955241 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:23.963294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:23.970918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:23.972219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-82a5955d-3663-427d-8fec-d3fbf6a507f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.293311 Feb 07 04:19:23.973394 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 345/702] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:23 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:24.990040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:24.991117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:24.999580 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:25.000026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:25.000897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:25.001325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:25.128367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:25.136071 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:25.137589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:25.138741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-466c938c-1d3c-4a76-98c3-c09b1f905c99 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.152898 Feb 07 04:19:25.139301 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 358/703] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:24 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:26.157354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:26.158009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:26.163894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:26.164382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:26.165194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:26.165634 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:26.299247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:26.306960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:26.308680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:26.309632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-15beec40-5223-4273-a2b4-9c1a88e99049 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1741 microversion: 2.20 time: 0.156061 Feb 07 04:19:26.310204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 346/704] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:26 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:19:27.328036 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:27.328601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:27.334484 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:27.334932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:27.335704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:27.336170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:27.477009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:27.484923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:27.486485 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:27.487688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-38a4aa79-2186-4bab-b558-935e4df34754 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1723 microversion: 2.20 time: 0.163469 Feb 07 04:19:27.488279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 359/705] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:27 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:28.508090 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:28.508698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:28.514837 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:28.515283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:28.516071 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:28.516508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:28.655381 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:28.663034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:28.664631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:28.665902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6118b74e-35a2-4fe6-b364-f6be1049e400 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1723 microversion: 2.20 time: 0.161438 Feb 07 04:19:28.666458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 347/706] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:28 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:19:29.273953 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-cbfaf006-c37d-4119-8c6f-ecf7b04e0a4b req-43dd2124-9da8-49fb-b818-1a419f8996b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "name": "network-vif-unplugged", "status": "completed", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:19:29.275530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:19:29.275530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:19:29.283188 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-cbfaf006-c37d-4119-8c6f-ecf7b04e0a4b req-43dd2124-9da8-49fb-b818-1a419f8996b3 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:29.283658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-cbfaf006-c37d-4119-8c6f-ecf7b04e0a4b req-43dd2124-9da8-49fb-b818-1a419f8996b3 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:29.294571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-cbfaf006-c37d-4119-8c6f-ecf7b04e0a4b req-43dd2124-9da8-49fb-b818-1a419f8996b3 service nova] Creating event network-vif-unplugged:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:19:29.299449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-cbfaf006-c37d-4119-8c6f-ecf7b04e0a4b req-43dd2124-9da8-49fb-b818-1a419f8996b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029120 Feb 07 04:19:29.300056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 360/707] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:19:29.684651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:29.685648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:29.692887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:29.693420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:29.694219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:29.694660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:29.847041 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:29.867224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:29.869132 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:29.870356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d73edd41-6370-48e9-ac1e-c8b2a560b035 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1723 microversion: 2.20 time: 0.190153 Feb 07 04:19:29.870913 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 348/708] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:29 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:30.888978 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:30.889681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:30.895551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:30.896004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:30.896854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:30.897293 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:31.028674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:31.036425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:31.037941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:31.039090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8495961f-bbb1-4d39-9f82-62fc5f4ca057 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1723 microversion: 2.20 time: 0.154670 Feb 07 04:19:31.039647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 361/709] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:30 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:32.057279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:32.057892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:32.064126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.064584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.065362 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.065807 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.210417 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:32.225137 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:32.227581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:32.229953 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-be30d69b-d19b-40ca-8adf-7c4fc989815b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1666 microversion: 2.20 time: 0.176265 Feb 07 04:19:32.239441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 349/710] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:32 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1666 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:32.248644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee2e308-f939-40ea-b4c2-f870fc146e6b"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:19:32.249714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:32.266850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.267392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.268239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.268686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.597686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c8d60212-7f21-4e5b-832f-34522266cf5b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353133 Feb 07 04:19:32.598295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 362/711] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Feb 7 04:19:32 2022] POST /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:19:32.707620 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:19:32.708228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:32.714039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.714527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.715265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.715705 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.811356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c307859e-a4ad-4eb3-8ef0-06da710f106f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/action" status: 202 len: 0 microversion: 2.20 time: 0.107354 Feb 07 04:19:32.814865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 350/712] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Feb 7 04:19:32 2022] POST /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 07 04:19:32.819958 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:32.820725 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:32.829010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.829541 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.830327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:32.830765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:32.965566 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:32.974508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:32.976124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:32.977265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f1735c97-b09c-45e0-aa4a-226ee4accb26 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1752 microversion: 2.20 time: 0.161124 Feb 07 04:19:32.977818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 363/713] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:32 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:33.996647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:33.997300 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:34.004035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:34.004675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:34.005464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:34.005904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:34.148755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:34.157859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:34.159360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:34.160541 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-454bf28e-d56e-4b4a-9bd2-806bdc35fba6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1754 microversion: 2.20 time: 0.168198 Feb 07 04:19:34.161100 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 351/714] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:33 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:34.681923 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:19:34.682146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:19:35.179668 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:35.180551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:35.187525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:35.187975 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:35.188805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:35.189239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:35.332703 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:35.341008 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:35.342545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:35.343697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5021f377-b940-4425-8860-c06eeac257c1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.167882 Feb 07 04:19:35.344339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 364/715] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:35 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:19:36.360733 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:36.361340 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:36.367677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:36.368155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:36.368911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:36.369347 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:36.523865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:36.539656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:36.545492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:36.548142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c637f03c-dc6c-494f-ad1f-afa09cea07ae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.190796 Feb 07 04:19:36.551040 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 352/716] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:36 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:37.568192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:37.568797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:37.574985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:37.575432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:37.576734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:37.577166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:37.712527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:37.721677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:37.723247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:37.724552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6aff6e3a-102a-4da3-91ef-300c71cc48af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.160009 Feb 07 04:19:37.725313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 365/717] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:37 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:38.742611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:38.743238 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:38.750420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:38.750870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:38.751708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:38.752198 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:38.904898 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:38.913878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:38.915320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:38.916512 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dbdf7a2b-ebdc-42dd-9f4d-fe639e550d9d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.177685 Feb 07 04:19:38.917069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 353/718] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:38 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:39.935235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:39.938836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:39.949968 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:39.951244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:39.952489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:39.953084 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:40.158416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:40.167908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:40.169955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:40.171635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1380f917-36d2-4670-bc1e-a4f98032318b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.240563 Feb 07 04:19:40.172653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 366/719] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:39 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:41.194609 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:41.195238 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:41.201544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:41.201998 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:41.202780 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:41.203223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:41.337286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:41.346521 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:41.348209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:41.349345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-27b8c78d-bd5d-43ef-a84d-47f98bf3218f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.158582 Feb 07 04:19:41.349908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 354/720] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:41 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:42.366999 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:42.367598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:42.374268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:42.374715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:42.375501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:42.376121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:42.521097 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:42.530400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:42.531527 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:42.532717 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-cdc83cfb-cb13-44bf-b7f0-fef7c2f2aa03 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.169513 Feb 07 04:19:42.533268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 367/721] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:42 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:43.550716 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:43.551318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:43.557431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:43.557874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:43.558646 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:43.559080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:43.694446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:43.703165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:43.704716 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:43.705877 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d00676d5-63b3-4c00-bb91-5347929bde23 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.158897 Feb 07 04:19:43.706431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 355/722] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:43 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:44.735025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:44.735783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:44.742946 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:44.743430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:44.744343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:44.744790 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:44.886674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:44.897548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:44.901570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:44.901570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fd19d834-9736-4406-b24d-75d9cd5d367f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.173524 Feb 07 04:19:44.901570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 368/723] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:44 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:45.920748 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:45.921477 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:45.927803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:45.928284 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:45.929061 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:45.929669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:46.212224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:46.220455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:46.221950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:46.223089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9476d0a9-ca40-48cb-bc3d-c00cdc59f783 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.306133 Feb 07 04:19:46.223642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 356/724] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:45 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:47.241413 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:47.242003 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:47.249551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:47.250000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:47.251240 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:47.251690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:47.446230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:47.455596 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:47.457139 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:47.458307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d40e5cb9-046b-4f85-9658-05b82b0ebc40 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.220987 Feb 07 04:19:47.459007 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 369/725] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:47 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:48.476870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:48.477645 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:48.486411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:48.486861 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:48.487657 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:48.488111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:48.635918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:48.644472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:48.645969 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:48.647241 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f6294278-f4ca-47b5-a2b4-a624a31f39e5 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.174135 Feb 07 04:19:48.647795 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 357/726] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:48 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:49.666877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:49.672281 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:49.679080 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:49.679666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:49.680565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:49.681003 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:49.817979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:49.828530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:49.830543 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:49.832196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5fcdfdd9-0f20-45bd-a42d-beb7cd59d6f0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.170033 Feb 07 04:19:49.832855 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 370/727] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:49 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:50.849784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:50.850387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:50.856621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:50.857650 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:50.858445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:50.858875 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:50.988744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:50.996777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:50.998258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:50.999943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-60eb4285-9843-489b-a2da-5abb0c4ba02d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.153316 Feb 07 04:19:51.000520 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 358/728] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:50 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:52.018361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:52.018965 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:52.025754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:52.026468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:52.027986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:52.028608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:52.168146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:52.176457 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:52.177958 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:52.179105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e6ab5f63-afc3-4d2b-89c9-e8396adb49e0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.164428 Feb 07 04:19:52.179653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 371/729] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:52 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:19:53.196846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:53.197451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:53.204016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:53.204498 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:53.205268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:53.205700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:53.335251 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:53.343749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:53.345260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:53.346392 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f257a16b-c367-4624-967e-fd374bf85b3d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.153239 Feb 07 04:19:53.346943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 359/730] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:53 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:54.364865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:54.365472 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:54.371670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:54.372160 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:54.372936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:54.373370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:54.502239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:54.510336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:54.511822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:54.513506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6cc0e5bf-dc27-495a-81f2-d9c618c1ad4c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.151929 Feb 07 04:19:54.514061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 372/731] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:54 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:55.531542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:55.532189 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:55.538841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:55.539292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:55.540088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:55.540529 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:55.673171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:55.681404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:55.682894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:55.684030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-057e7fab-d15b-4749-8459-0274d76e0c16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.156180 Feb 07 04:19:55.684635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 360/732] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:55 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:56.702637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:56.703247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:56.709119 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:56.709574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:56.710353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:56.710793 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:56.842611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:56.850745 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:56.852260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:56.853408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f93f1f38-2b46-44f3-8ab0-1dd312a2e2ac tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.155168 Feb 07 04:19:56.853954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 373/733] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:56 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:57.986037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:57.986719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:57.992633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:57.993170 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:57.994003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:57.994507 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:58.124992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:58.133070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:58.134554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:58.135689 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e9c64cc6-c900-4f3b-bc78-73ba2ebe41c4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.267287 Feb 07 04:19:58.136275 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 361/734] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:57 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:19:58.476861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:19:58.477403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:19:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:19:59.155687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:19:59.156341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:19:59.162768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:59.163227 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:59.164903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:19:59.164903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:19:59.302009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:59.312672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:59.314478 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:19:59.316025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e343c30c-4261-4874-a510-4814e80e44d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.164951 Feb 07 04:19:59.316600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 374/735] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:19:59 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:00.338488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:00.339014 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:00.345921 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:00.346375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:00.347187 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:00.347627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:00.490942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:00.499570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:00.501350 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:00.502545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-160756bc-ee98-4a4d-beb1-199ea691a12d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.167850 Feb 07 04:20:00.503092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 362/736] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:00 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:01.520812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:01.521350 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:01.527774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:01.528262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:01.529028 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:01.529458 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:01.659504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:01.667609 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:01.669778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:01.670916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bea9c800-6caa-4e73-ac5d-7d04c425c8de tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.153863 Feb 07 04:20:01.671465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 375/737] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:01 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:02.688413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:02.689878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:02.697389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:02.697849 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:02.698651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:02.699915 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:02.854220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:02.863581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:02.865111 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:02.866538 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2f4cd115-817d-4389-9d27-80c3e8b41b9b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.181569 Feb 07 04:20:02.867106 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 363/738] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:02 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:03.884166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:03.884778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:03.891607 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:03.892082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:03.892916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:03.893353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:04.035199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:04.043423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:04.045718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:04.046888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-822fb2d9-642c-4fcf-9f4c-79db581cdd94 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.166593 Feb 07 04:20:04.047449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 376/739] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:03 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:05.065298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:05.065994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:05.072203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:05.072661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:05.073442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:05.073902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:05.204865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:05.213054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:05.214550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:05.215903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2f684b3a-ed94-4c68-966b-37316420f598 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.154228 Feb 07 04:20:05.216295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 364/740] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:05 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:06.233479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:06.234092 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:06.240902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:06.241380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:06.242419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:06.243127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:06.383192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:06.392070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:06.393570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:06.394727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-40e36af2-9915-47e4-ad57-fd494c70a8e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.165010 Feb 07 04:20:06.395279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 377/741] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:06 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:07.413535 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:07.414177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:07.420480 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:07.420937 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:07.421717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:07.422155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:07.553777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:07.562685 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:07.564191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:07.565325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-53bb209e-1494-415a-a186-608f51f900e8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.155470 Feb 07 04:20:07.565877 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 365/742] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:07 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:08.582635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:08.583235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:08.589351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:08.589795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:08.590565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:08.590992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:08.722759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:08.731693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:08.733226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:08.734365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a13753ce-c849-401a-b880-2c6b7247df52 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.155318 Feb 07 04:20:08.734899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 378/743] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:08 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:09.753559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:09.754265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:09.760979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:09.761430 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:09.762219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:09.763149 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:09.896701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:09.905261 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:09.906762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:09.907906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a5ea7a70-0c0c-4523-aeff-548daaad2a80 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.158460 Feb 07 04:20:09.908492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 366/744] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:09 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:10.925600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:10.926204 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:10.932364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:10.932806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:10.933570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:10.934000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:11.061150 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:11.069190 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:11.070611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:11.071741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d8685bf8-55f6-478f-b66d-f475bf2213a6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.149814 Feb 07 04:20:11.072329 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 379/745] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:10 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:12.089580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:12.090165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:12.097042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:12.097499 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:12.098292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:12.098733 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:12.232785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:12.240826 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:12.242317 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:12.243453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ecc944c0-f85a-498a-ada8-96eae8c900b0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.157683 Feb 07 04:20:12.244011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 367/746] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:12 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:13.261569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:13.262173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:13.269056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:13.269503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:13.270305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:13.270732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:13.611038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:13.619859 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:13.620820 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:13.621985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-583ff8f6-5edf-4ee0-a0df-05c43a885947 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.364168 Feb 07 04:20:13.623395 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 380/747] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:13 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:14.640036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:14.640776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:14.646912 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:14.647376 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:14.648188 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:14.648633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:14.786346 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:14.794772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:14.796612 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:14.797816 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0b6c80ba-01a4-4c32-aead-42f7fe614584 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.161411 Feb 07 04:20:14.798493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 368/748] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:14 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:15.815506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:15.816141 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:15.822384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:15.822830 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:15.823596 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:15.824030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:15.954794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:15.963209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:15.964731 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:15.965912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-898f4ef7-9ddd-4bb6-bd75-bd2c0a30a486 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.154027 Feb 07 04:20:15.966987 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 381/749] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:15 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:16.983726 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:16.984440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:16.993038 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:16.993488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:16.994267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:16.994698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:17.127570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:17.135655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:17.137157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:17.138292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-585a5e62-2b17-49f4-aba1-547090347040 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.158782 Feb 07 04:20:17.138844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 369/750] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:16 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:18.156945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:18.157557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:18.163680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:18.164160 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:18.164926 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:18.165356 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:18.299239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:18.307587 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:18.309122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:18.310289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8eab5a0b-1b14-4000-b882-60edf9c7b0e1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.157552 Feb 07 04:20:18.310862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 382/751] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:18 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:19.328082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:19.328662 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:19.335000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:19.335483 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:19.336323 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:19.336758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:19.465768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:19.473880 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:19.475369 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:19.476527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f4e25393-2943-4bb6-adcb-2978ce3490d8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.152261 Feb 07 04:20:19.477109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 370/752] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:19 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:20.495616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:20.496260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:20.503016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:20.503467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:20.504272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:20.504709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:20.633242 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:20.641927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:20.643497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:20.644667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e26a6283-c8c3-43c2-81fb-574c45aa6b16 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.152748 Feb 07 04:20:20.645222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 383/753] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:20 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:21.662736 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:21.663359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:21.669602 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:21.670053 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:21.670828 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:21.671267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:21.805626 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:21.814197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:21.815700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:21.816883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9f22fd4c-885d-4d06-859f-1bfb9673a185 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.157812 Feb 07 04:20:21.817439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 371/754] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:21 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:22.834549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:22.835154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:22.841380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:22.841828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:22.842594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:22.843026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:22.971566 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:22.980420 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:22.981943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:22.983077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8d2f56c5-eb2e-4d56-994b-86df62e49f51 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.152226 Feb 07 04:20:22.983612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 384/755] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:22 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:24.001401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:24.002013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:24.008275 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:24.008729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:24.009510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:24.009949 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:24.138642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:24.146784 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:24.148302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:24.149477 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-76ed4cdf-2363-458e-9231-88ae262908d1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.152318 Feb 07 04:20:24.150038 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 372/756] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:23 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:25.168792 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:25.169489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:25.176906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:25.177354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:25.178322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:25.178711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:25.316868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:25.325978 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:25.327473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:25.329262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3898ea12-bab2-4b85-bb30-83d8abdcb213 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.164597 Feb 07 04:20:25.329819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 385/757] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:25 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:26.009452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-dc86e62c-9e77-462c-aeed-c73c9d77f3e5 req-d44d16e6-b31d-406a-8158-cf7ae0b80181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "name": "network-vif-plugged", "status": "completed", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:20:26.011054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:20:26.011054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:20:26.017864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-dc86e62c-9e77-462c-aeed-c73c9d77f3e5 req-d44d16e6-b31d-406a-8158-cf7ae0b80181 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:26.018317 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-dc86e62c-9e77-462c-aeed-c73c9d77f3e5 req-d44d16e6-b31d-406a-8158-cf7ae0b80181 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:26.029287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-dc86e62c-9e77-462c-aeed-c73c9d77f3e5 req-d44d16e6-b31d-406a-8158-cf7ae0b80181 service nova] Creating event network-vif-plugged:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:20:26.034321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-dc86e62c-9e77-462c-aeed-c73c9d77f3e5 req-d44d16e6-b31d-406a-8158-cf7ae0b80181 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166014 Feb 07 04:20:26.035129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 373/758] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:20:26.348905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:26.349583 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:26.356562 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:26.357220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:26.358272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:26.358750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:26.557766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:26.567276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:26.568949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:26.570343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-74b13888-8b06-413d-b5ad-58d5acfdac38 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.226790 Feb 07 04:20:26.571577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 386/759] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:26 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:27.590072 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:27.590864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:27.597038 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:27.597557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:27.598592 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:27.599095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:27.763085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:27.771949 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:27.773569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:27.774839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-02fcb185-4ac9-4897-a409-e7692c3764a4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.189620 Feb 07 04:20:27.775844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 374/760] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:27 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:28.795850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:28.796776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:28.803350 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:28.803858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:28.806678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:28.807207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:28.961518 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:28.970809 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:28.972351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:28.973517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8da9964c-3489-44d8-90d5-27b8a3920b07 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1810 microversion: 2.20 time: 0.183589 Feb 07 04:20:28.974057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 387/761] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:28 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:20:29.991242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:20:29.992564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:20:30.000540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:30.001473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:30.002478 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:20:30.003129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:20:30.184220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:30.196079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:30.201390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:20:30.202751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e7dfa168-d85a-4707-89a6-56dbc21088c9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1797 microversion: 2.20 time: 0.215380 Feb 07 04:20:30.204205 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 375/762] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:20:29 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1797 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:21:14.142630 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f6557c6-28fa-4cfb-887a-ac61c3749e96"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:21:14.143729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:14.149512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:14.149955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:14.150721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:14.151394 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:17.159559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0847ae24-daa1-4e7c-a78e-a0a8bed627a9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.021163 Feb 07 04:21:17.160378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 388/763] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:21:14 2022] POST /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 194 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:21:26.803707 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-df68419c-be56-4483-aa13-985be3e83682 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:21:26.809820 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df68419c-be56-4483-aa13-985be3e83682 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:26.810269 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-df68419c-be56-4483-aa13-985be3e83682 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:26.872134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-df68419c-be56-4483-aa13-985be3e83682 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Going to try to stop instance {{(pid=116492) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 07 04:21:26.914644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-df68419c-be56-4483-aa13-985be3e83682 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/action" status: 202 len: 0 microversion: 2.1 time: 0.114902 Feb 07 04:21:26.915192 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 376/764] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:21:26 2022] POST /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:21:26.924171 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:26.924935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:26.931806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:26.932353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:26.933142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:26.933576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:27.078409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:27.086397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2fff7d2e-8670-46a5-8b93-35e2033597f4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.166777 Feb 07 04:21:27.086957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 389/765] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:26 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:28.105343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:28.106033 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:28.112016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:28.112491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:28.113258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:28.114260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:28.245975 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:28.253869 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5c84ae26-b7e0-4aa1-9ac4-4b7b5d934dfd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.153348 Feb 07 04:21:28.255047 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 377/766] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:28 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:29.273288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:29.273802 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:29.280595 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:29.281051 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:29.281842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:29.282314 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:29.414402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:29.422116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-48384209-81ac-47e8-b4e0-066ea521bbb7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.154902 Feb 07 04:21:29.422678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 390/767] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:29 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:30.439729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:30.440393 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:30.447332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:30.447783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:30.448591 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:30.449029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:30.588119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:30.595778 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1f065b03-98b7-4d08-add0-9d3635e159f7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.159647 Feb 07 04:21:30.596361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 378/768] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:30 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:31.612868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:31.613461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:31.620241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:31.620700 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:31.621483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:31.621956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:31.748743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:31.756382 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-68071d6a-913f-4581-88b5-eae579b0c7ba tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.147270 Feb 07 04:21:31.756942 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 391/769] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:31 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:32.773685 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:32.774308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:32.781120 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:32.781569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:32.782348 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:32.782783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:32.914997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:32.922636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a05b0b75-8e3a-4ef3-b260-3147c962c347 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.153167 Feb 07 04:21:32.923195 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 379/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:32 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:33.939529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:33.940191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:33.946386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:33.946867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:33.947644 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:33.948102 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:34.078670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:34.086966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-affa95bd-723c-47a9-8280-6b0cee5cdb49 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.151099 Feb 07 04:21:34.087539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 392/771] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:33 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:35.104438 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:35.105074 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:35.111227 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:35.111676 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:35.112593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:35.112981 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:35.247608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:35.255531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e34117a1-dba7-4773-8298-8c44d2d20ff0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.154763 Feb 07 04:21:35.256206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 380/772] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:35 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:36.272106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:36.272726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:36.279508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:36.279969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:36.280785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:36.281229 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:36.420699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:36.428531 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7454b0c2-979e-43cc-869f-c3700279f35f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.160599 Feb 07 04:21:36.429096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 393/773] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:36 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:37.446221 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:37.447536 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:37.454141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:37.454799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:37.455595 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:37.456027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:37.598004 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:37.606258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4d79bc0b-8adc-4c70-9599-5243cde5c36a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.163629 Feb 07 04:21:37.606822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 381/774] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:37 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:38.623679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:38.624341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:38.631341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:38.631789 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:38.632669 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:38.633107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:38.763664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:38.772719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e28e0520-3a90-4fa6-a707-71ce8b2ed027 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.152461 Feb 07 04:21:38.776263 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 394/775] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:38 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:39.792642 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:39.793252 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:39.799433 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:39.799883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:39.800695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:39.801133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:39.931320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:39.939746 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3f76b6dc-27aa-4211-8065-e93713af783e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.150673 Feb 07 04:21:39.940667 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 382/776] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:39 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:40.958591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:40.959731 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:40.966062 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:40.966516 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:40.967329 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:40.967768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:41.096620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:41.104414 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-439ec19f-b91f-4535-82b3-226996ea728a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.149516 Feb 07 04:21:41.104984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 395/777] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:40 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:42.121026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:42.121662 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:42.127845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:42.128321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:42.129093 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:42.129530 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:42.271457 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:42.279570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9063b65c-1e5f-4726-81b2-10282ba44160 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.162241 Feb 07 04:21:42.280163 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 383/778] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:42 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:43.296685 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:43.297290 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:43.303528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:43.303972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:43.304853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:43.305288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:43.436326 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:43.444512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f511fc0c-943d-4812-a82e-cc53e28c67d0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.151425 Feb 07 04:21:43.445075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 396/779] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:43 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:44.463063 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:44.463063 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:44.467754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:44.468174 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:44.469064 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:44.469384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:44.601772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:44.609469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ffa27c23-9a8a-4b02-bf7a-a1f808f26dcd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.152497 Feb 07 04:21:44.610029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 384/780] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:44 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:45.626216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:45.626940 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:45.634195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:45.634641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:45.635429 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:45.635863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:45.780916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:45.789944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8ac1f43f-cfc6-4de2-bfe5-444f3af2fdb4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.167330 Feb 07 04:21:45.790506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 397/781] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:45 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:46.807521 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:46.808160 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:46.814738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:46.815190 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:46.815969 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:46.816431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:46.961582 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:46.969359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2dd11d83-9183-4e4c-980b-a036eccd7a75 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1722 microversion: 2.1 time: 0.166050 Feb 07 04:21:46.969918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 385/782] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:46 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:47.986517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:47.987132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:47.993348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:47.993803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:47.994584 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:47.995021 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:48.189757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:48.198381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9bbffafe-681e-4cd7-923e-eb5301b45498 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1699 microversion: 2.1 time: 0.215474 Feb 07 04:21:48.199332 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 398/783] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:47 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1699 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:48.215271 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e9daa59b-d700-41e1-b5ce-7251ae13a179 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:21:48.221929 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9daa59b-d700-41e1-b5ce-7251ae13a179 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:48.222542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e9daa59b-d700-41e1-b5ce-7251ae13a179 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:48.246572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e9daa59b-d700-41e1-b5ce-7251ae13a179 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Going to try to start instance {{(pid=116492) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 07 04:21:48.288851 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e9daa59b-d700-41e1-b5ce-7251ae13a179 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/action" status: 202 len: 0 microversion: 2.1 time: 0.077298 Feb 07 04:21:48.289567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 386/784] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:21:48 2022] POST /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:21:48.307788 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:48.308489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:48.316152 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:48.316563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:48.317512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:48.318085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:48.459391 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:48.467463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-44194cbe-0d25-40d9-9d3b-55f96c9169a4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1708 microversion: 2.1 time: 0.168667 Feb 07 04:21:48.468039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 399/785] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:48 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:49.486680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:49.487305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:49.493680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:49.494135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:49.494936 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:49.495373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:49.761066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:49.768835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f763b1f9-56b9-4701-a03c-681e7042ce27 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1708 microversion: 2.1 time: 0.286838 Feb 07 04:21:49.769411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 387/786] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:49 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1708 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:50.786714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:50.787867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:50.794096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:50.794555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:50.795339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:50.795783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:50.936217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:50.943954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9406f31c-4724-49fa-87b7-7b97d3271d2b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1712 microversion: 2.1 time: 0.161148 Feb 07 04:21:50.944541 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 400/787] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:50 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1712 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:51.509358 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-487562241", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "99875bed-ca00-4d1c-bf5e-abfbd81f5ac7"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:21:51.561789 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] validate_networks() for [('99875bed-ca00-4d1c-bf5e-abfbd81f5ac7', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:21:51.945660 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:21:51.946086 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:21:51.946563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:21:51.946973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:21:51.947394 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:21:51.956205 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:51.956655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:51.957463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:51.957897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:51.973570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Getting quotas for project ef628b18fee54b219122e9accae291b4. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:21:51.977451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Getting quotas for user b509b217add444b191e92b67f18614cd and project ef628b18fee54b219122e9accae291b4. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:21:51.987786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:21:51.990618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:21:52.033804 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3bebed08-fa8e-4bbf-9c16-4c5546ab80d2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528024 Feb 07 04:21:52.034443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 388/788] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:21:52.044137 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c90a0279-707c-4729-8476-8dc3e124e20e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:52.044767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c90a0279-707c-4729-8476-8dc3e124e20e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:52.099252 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c90a0279-707c-4729-8476-8dc3e124e20e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:52.105882 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c90a0279-707c-4729-8476-8dc3e124e20e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1218 microversion: 2.1 time: 0.065500 Feb 07 04:21:52.106448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 401/789] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:52 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:53.123176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:53.123788 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:53.130638 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:53.131443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:53.132458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:53.132910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:53.211237 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:53.220893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e97a2c49-1641-462a-8b9e-e380c05e7933 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1278 microversion: 2.1 time: 0.101909 Feb 07 04:21:53.221471 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 389/790] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:53 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:54.238344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:54.239140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:54.246673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:54.247162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:54.247943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:54.248403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:54.385571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:54.393155 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-25ef2754-fbfa-4488-bff4-a5aae8b7557a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.158364 Feb 07 04:21:54.394099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 402/791] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:54 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:54.498545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-682d0483-684e-47fc-9761-14bd67fddceb req-c6dba0be-d736-4a1a-ac1d-a4d5e08d61e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28310380-b13c-4436-8743-98b0f7ef3883", "tag": "d6ff01d2-3879-49d1-9db0-2165e670c23a"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:21:54.500124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:21:54.500124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:21:54.507511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-682d0483-684e-47fc-9761-14bd67fddceb req-c6dba0be-d736-4a1a-ac1d-a4d5e08d61e1 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:54.507954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-682d0483-684e-47fc-9761-14bd67fddceb req-c6dba0be-d736-4a1a-ac1d-a4d5e08d61e1 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:54.518264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-682d0483-684e-47fc-9761-14bd67fddceb req-c6dba0be-d736-4a1a-ac1d-a4d5e08d61e1 service nova] Creating event network-changed:d6ff01d2-3879-49d1-9db0-2165e670c23a for instance 28310380-b13c-4436-8743-98b0f7ef3883 on hv-cinder-79963 Feb 07 04:21:54.523129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-682d0483-684e-47fc-9761-14bd67fddceb req-c6dba0be-d736-4a1a-ac1d-a4d5e08d61e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158624 Feb 07 04:21:54.523709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 390/792] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:21:55.410099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:55.410737 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:55.416982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:55.417440 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:55.418210 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:55.418648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:55.550408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:55.557482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3b5943d1-b801-483e-94b1-d0aa0abd7f17 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.151052 Feb 07 04:21:55.558042 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 403/793] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:55 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:56.573887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:56.574587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:56.580665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:56.581115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:56.581887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:56.582325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:56.716379 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:56.723538 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5946606c-b70f-45d8-a560-294838cded59 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.154174 Feb 07 04:21:56.724119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 391/794] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:56 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:57.740535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:57.741143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:57.747029 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:57.747473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:57.748274 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:57.748716 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:57.881015 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:57.888293 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8bdd3da7-5040-48ee-93cd-b4328f75aa2c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.151588 Feb 07 04:21:57.888856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 404/795] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:57 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:21:58.905631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:21:58.906239 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:21:58.913012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:58.913458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:58.914222 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:21:58.914653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:21:59.042483 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:21:59.049836 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5c9061d0-7bb4-4ac0-8d68-db916ea8595c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.147874 Feb 07 04:21:59.059024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 392/796] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:21:58 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:00.066569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:00.067123 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:00.073448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:00.073902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:00.074678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:00.075117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:00.209364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:00.216658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-74a2a3a4-f5dc-4413-a5fd-5e242c474e27 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.153856 Feb 07 04:22:00.217213 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 405/797] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:00 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:01.233684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:01.234244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:01.240388 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:01.240833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:01.241599 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:01.242031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:01.389846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:01.397779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0cc77ea8-615d-41cd-b509-521c5274e812 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.167803 Feb 07 04:22:01.398341 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 393/798] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:01 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:01.599775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:01.600802 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:01.607838 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:01.608327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:01.609122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:01.609560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:01.682639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5ee7762d-c65c-4ada-9b39-f87f1fa1dba3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/action" status: 202 len: 0 microversion: 2.1 time: 0.186683 Feb 07 04:22:01.683321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 406/799] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:22:01 2022] POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:22:01.692577 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:01.693768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:01.699561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:01.699987 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:01.700946 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:01.701440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:01.879471 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:01.887933 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ea19675e-8d3a-4e1a-9311-35c3e9d88d7f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1752 microversion: 2.1 time: 0.200397 Feb 07 04:22:01.888566 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 394/800] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:01 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:02.360945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-ca1a189b-d236-4a80-8bcc-6dac737743ae req-1f0a58e2-81da-4b44-9299-5abd5c278326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28310380-b13c-4436-8743-98b0f7ef3883", "name": "network-vif-plugged", "status": "completed", "tag": "d6ff01d2-3879-49d1-9db0-2165e670c23a"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:02.362495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:02.362495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:22:02.372893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-ca1a189b-d236-4a80-8bcc-6dac737743ae req-1f0a58e2-81da-4b44-9299-5abd5c278326 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:02.373346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-ca1a189b-d236-4a80-8bcc-6dac737743ae req-1f0a58e2-81da-4b44-9299-5abd5c278326 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:02.385502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-ca1a189b-d236-4a80-8bcc-6dac737743ae req-1f0a58e2-81da-4b44-9299-5abd5c278326 service nova] Creating event network-vif-plugged:d6ff01d2-3879-49d1-9db0-2165e670c23a for instance 28310380-b13c-4436-8743-98b0f7ef3883 on hv-cinder-79963 Feb 07 04:22:02.390461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-ca1a189b-d236-4a80-8bcc-6dac737743ae req-1f0a58e2-81da-4b44-9299-5abd5c278326 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033460 Feb 07 04:22:02.391461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 407/801] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:22:02.415076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:02.415689 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:02.422066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:02.422517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:02.423372 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:02.423813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:02.673162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:02.680416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-817fdf37-97d1-466b-abf1-8c7a44a87253 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.269690 Feb 07 04:22:02.680983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 395/802] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:02 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:02.905602 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:02.906290 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:02.913313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:02.913753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:02.914522 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:02.914953 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:03.059747 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:03.067569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-768fb80e-8cb9-4a1b-8226-96180184bebe tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.165897 Feb 07 04:22:03.068142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 408/803] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:02 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:03.696935 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:03.697547 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:03.703731 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:03.704227 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:03.705010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:03.705451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:03.835954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:03.843128 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6b8903fc-9325-4cdc-98f9-c64849fd1a1a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1318 microversion: 2.1 time: 0.150376 Feb 07 04:22:03.843695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 396/804] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:03 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:04.085149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:04.085701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:04.091912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:04.092404 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:04.093187 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:04.093627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:04.238166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:04.246431 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6d22e89e-e03f-4975-a3e6-16e133692a0b tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.165169 Feb 07 04:22:04.246992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 409/805] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:04 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:04.858501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:04.859113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:04.865407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:04.865859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:04.866637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:04.867079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:05.001923 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:05.009089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-40fae614-396b-4026-b640-bfcb4928d5c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1508 microversion: 2.1 time: 0.154271 Feb 07 04:22:05.009654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 397/806] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:04 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:05.263903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:05.264543 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:05.272602 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:05.273049 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:05.273842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:05.274284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:05.446064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:05.454351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-681631fd-3316-4661-91a6-ecaedca30f15 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.193982 Feb 07 04:22:05.455042 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 410/807] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:05 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:06.473173 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:06.473773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:06.480606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:06.481071 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:06.481819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:06.482250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:06.621751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:06.629384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-17f6271b-53d8-459f-9dee-926fafd2d269 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.159933 Feb 07 04:22:06.629957 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 398/808] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:06 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:07.646765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:07.647377 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:07.654426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:07.654885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:07.655672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:07.656143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:07.801372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:07.809156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f138538e-b846-4620-b459-5ce5ba611449 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.166137 Feb 07 04:22:07.809720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 411/809] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:07 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:08.826573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:08.827105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:08.833904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:08.834354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:08.835143 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:08.835573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:08.978344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:08.986070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-edab7bf1-04a4-427e-aea0-8bff42880737 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.163638 Feb 07 04:22:08.986636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 399/810] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:08 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:10.003354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:10.003960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:10.010957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:10.011406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:10.012202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:10.012632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:10.162693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:10.170437 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-26b4eeef-1e8b-4fbe-a8f5-804d98e7fdd1 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.170701 Feb 07 04:22:10.171075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 412/811] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:09 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:11.188179 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:11.188794 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:11.195031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:11.195485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:11.196292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:11.196735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:11.343194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:11.351407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c9e822ae-5652-404d-a383-788fa23911d2 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.166769 Feb 07 04:22:11.351971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 400/812] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:11 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:12.368720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:12.369392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:12.375670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:12.376162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:12.376943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:12.377380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:12.521891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:12.529887 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-00d0129b-9271-45fe-b0cd-6a22cce5c553 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.165361 Feb 07 04:22:12.530456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 413/813] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:12 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:13.546425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:13.547036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:13.553304 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:13.553754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:13.554564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:13.555008 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:13.710160 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:13.717797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-03d147f6-8920-4930-a88f-c7194d7373af tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.175063 Feb 07 04:22:13.718364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 401/814] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:13 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:14.734451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:14.735055 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:14.741494 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:14.741945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:14.742725 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:14.743158 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:14.889030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:14.897232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e47d7c18-946b-433a-a238-9249f0b4ec70 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.166276 Feb 07 04:22:14.903546 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 414/815] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:14 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:15.916470 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:15.917626 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:15.924356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:15.924810 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:15.925587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:15.926025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:16.071030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:16.078789 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cdbca529-b4a2-49ab-a123-0488a8f706d3 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.168095 Feb 07 04:22:16.079365 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 402/816] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:15 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:17.095972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:17.096679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:17.103535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:17.103985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:17.104794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:17.105229 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:17.254781 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:17.262416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c4b3388a-ce7a-4c4e-9bd4-4a976806c2e9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.170092 Feb 07 04:22:17.262971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 415/817] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:17 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:18.151575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:18.152123 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:18.158735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.159182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.159954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.160413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.188842 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-38be0c04-ddb6-4ae8-94d1-bdc27f1cb2db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments/2ee2e308-f939-40ea-b4c2-f870fc146e6b" status: 200 len: 194 microversion: 2.20 time: 0.041770 Feb 07 04:22:18.189416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 403/818] 10.222.0.13 () {60 vars in 1453 bytes} [Mon Feb 7 04:22:18 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments/2ee2e308-f939-40ea-b4c2-f870fc146e6b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:22:18.247816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:18.248405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:18.254951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.255496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.256435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.256880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.285506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:18.286121 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:18.293070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.293814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.294687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.295223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.334897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lazy-loading 'services' on Instance uuid 09f8629b-adac-41b3-a311-37fc873a7a29 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:22:18.407120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b79d7d03-fde5-453f-9d10-1aee93a4ee9a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments/2ee2e308-f939-40ea-b4c2-f870fc146e6b" status: 202 len: 0 microversion: 2.20 time: 0.162979 Feb 07 04:22:18.408343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 416/819] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Feb 7 04:22:18 2022] DELETE /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments/2ee2e308-f939-40ea-b4c2-f870fc146e6b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:22:18.417828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:18.418908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:18.425313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.425773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.426628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:18.427061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:18.451486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:18.457971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-927b2985-b244-4cd6-93fe-e276f88d95e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045137 Feb 07 04:22:18.458881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 417/820] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Feb 7 04:22:18 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:22:18.466115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-46d1449e-14c9-4efd-8d8d-cc0e0f64eb02 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1757 microversion: 2.1 time: 0.184197 Feb 07 04:22:18.466684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 404/821] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:18 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:19.470091 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:19.471000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:19.477203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:19.477685 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:19.478462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:19.478900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:19.484413 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:19.485035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:19.491131 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:19.491586 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:19.492391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:19.492825 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:19.507335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-cd7ef823-e5da-4524-bb5f-cd7d1baf560d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041027 Feb 07 04:22:19.508708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 418/822] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Feb 7 04:22:19 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:22:19.633535 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:19.641171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bdb3045e-274b-4f4c-9a33-51413a8563b9 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1760 microversion: 2.1 time: 0.160329 Feb 07 04:22:19.641736 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 405/823] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:19 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:20.519099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:20.520090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:20.526590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:20.527039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:20.527819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:20.528299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:20.556067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d69a646d-1e6f-4d24-a3b1-6ac704dc00d6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040786 Feb 07 04:22:20.556611 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 419/824] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Feb 7 04:22:20 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:20.609276 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:20.609761 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:20.616019 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:20.616454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:20.617730 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:20.618164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:20.647005 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:22:20.718918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-73a5b227-4a0a-4a74-937f-0aee62896e35 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 204 len: 0 microversion: 2.20 time: 0.113029 Feb 07 04:22:20.719597 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 406/825] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:22:20 2022] DELETE /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 07 04:22:20.728348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:20.728994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:20.734753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:20.735202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:20.735994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:20.736434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:20.867502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:20.875133 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:20.876710 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:20.877865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6eca103e-9709-473e-b677-a5b2d43e3379 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.153777 Feb 07 04:22:20.878415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 420/826] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:20 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:22:21.897069 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:21.898900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:21.905528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:21.905975 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:21.906758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:21.907225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:22.039319 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:22.046983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:22.048442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:22.049583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f99ff6d6-b089-4367-8771-e24d1b480bbe tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.156596 Feb 07 04:22:22.050140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 407/827] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:21 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:23.067472 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:23.068102 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:23.074349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:23.074801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:23.075575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:23.076012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:23.210124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:23.217818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:23.219390 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:23.220578 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-088fe7fb-ff43-4dec-be7c-e77cea1adc06 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.156818 Feb 07 04:22:23.221156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 421/828] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:23 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:24.246984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:24.246984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:24.246984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:24.246984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:24.247698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:24.248147 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:24.593575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:24.601545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:24.603061 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:24.604251 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-260b21fe-7570-4c51-8c01-007ca462e970 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1725 microversion: 2.20 time: 0.369115 Feb 07 04:22:24.604833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 408/829] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:24 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:25.028462 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-624bf30b-3da5-46bd-b872-85f5266f09b2 req-3edd37c1-8217-4176-82b1-272b35b71d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f8629b-adac-41b3-a311-37fc873a7a29", "name": "network-vif-deleted", "tag": "cbc3f1ce-2c7b-48d3-b9c8-8dabac259084"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:25.030075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:25.030075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:22:25.038109 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-624bf30b-3da5-46bd-b872-85f5266f09b2 req-3edd37c1-8217-4176-82b1-272b35b71d19 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:25.038567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-624bf30b-3da5-46bd-b872-85f5266f09b2 req-3edd37c1-8217-4176-82b1-272b35b71d19 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:25.050550 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-624bf30b-3da5-46bd-b872-85f5266f09b2 req-3edd37c1-8217-4176-82b1-272b35b71d19 service nova] Creating event network-vif-deleted:cbc3f1ce-2c7b-48d3-b9c8-8dabac259084 for instance 09f8629b-adac-41b3-a311-37fc873a7a29 on hv-cinder-79963 Feb 07 04:22:25.056102 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-624bf30b-3da5-46bd-b872-85f5266f09b2 req-3edd37c1-8217-4176-82b1-272b35b71d19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Feb 07 04:22:25.060363 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 422/830] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:22:25.621995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:25.622730 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:25.629883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:25.630606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:25.631491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:25.632028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:25.668208 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:25.668785 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:25.669336 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lazy-loading 'fault' on Instance uuid 09f8629b-adac-41b3-a311-37fc873a7a29 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:22:25.735922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:25.748161 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:25.752203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:25.754403 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-65a1a154-67d0-4f8a-ba94-9d646e4c600a tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 200 len: 1372 microversion: 2.20 time: 0.135534 Feb 07 04:22:25.755084 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 409/831] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:25 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 1372 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:26.774403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:26.775140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:26.782434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:26.782898 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:26.783715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:26.784218 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:26.802310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 09f8629b-adac-41b3-a311-37fc873a7a29 could not be found. Feb 07 04:22:26.803026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 09f8629b-adac-41b3-a311-37fc873a7a29 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:22:26.803860 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f0f7c0c4-5deb-4c4f-b200-ee101f21f7dd tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 404 len: 111 microversion: 2.20 time: 0.034108 Feb 07 04:22:26.804448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 423/832] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:26 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:22:26.813338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5334c759-4694-4e21-9017-b0718683d5e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b25a670>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:26.835224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5334c759-4694-4e21-9017-b0718683d5e7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941670958" status: 204 len: 0 microversion: 2.20 time: 0.025527 Feb 07 04:22:26.835807 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 410/833] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941670958 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 07 04:22:27.522049 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-09f72dd5-e677-4312-9dfb-dbb4276eadae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'create', calling method: .version_select at 0x7f917b277940>, body: {"keypair": {"name": "tempest-keypair-1374816793"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:27.536865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-09f72dd5-e677-4312-9dfb-dbb4276eadae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:22:27.540921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-09f72dd5-e677-4312-9dfb-dbb4276eadae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for user 9140d220db624cf89b9e010215040eb2 and project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:22:27.699686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-09f72dd5-e677-4312-9dfb-dbb4276eadae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:22:27.703347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-09f72dd5-e677-4312-9dfb-dbb4276eadae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for user 9140d220db624cf89b9e010215040eb2 and project aafc4147461248299eee9b97ebd42995. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:22:27.718016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-09f72dd5-e677-4312-9dfb-dbb4276eadae tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.199697 Feb 07 04:22:27.723653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 424/834] 10.222.0.13 () {62 vars in 1198 bytes} [Mon Feb 7 04:22:27 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 07 04:22:28.963754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-772374264", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "035a4eca-c650-4fdd-bb42-ea519a7b428e"}], "security_groups": [{"name": "tempest-securitygroup--583988590"}], "key_name": "tempest-keypair-1374816793", "user_data": "}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:29.060571 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] validate_networks() for [('035a4eca-c650-4fdd-bb42-ea519a7b428e', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:22:29.414520 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:22:29.414944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:22:29.415446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:22:29.415856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:22:29.416302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:22:29.424799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:29.425243 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:29.426052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:29.426487 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:29.442620 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for project aafc4147461248299eee9b97ebd42995. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:22:29.447361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Getting quotas for user 9140d220db624cf89b9e010215040eb2 and project aafc4147461248299eee9b97ebd42995. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:22:29.458364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:22:29.460741 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:22:29.506916 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-27295586-97fc-4669-9884-80f02cb24081 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.547942 Feb 07 04:22:29.507557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 411/835] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Feb 7 04:22:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 07 04:22:29.518200 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-22d105ff-633e-4f4b-8571-263b5413e416 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:29.518822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-22d105ff-633e-4f4b-8571-263b5413e416 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:29.570624 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-22d105ff-633e-4f4b-8571-263b5413e416 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:29.579064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-22d105ff-633e-4f4b-8571-263b5413e416 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:29.580561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-22d105ff-633e-4f4b-8571-263b5413e416 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:29.581691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-22d105ff-633e-4f4b-8571-263b5413e416 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1281 microversion: 2.20 time: 0.067580 Feb 07 04:22:29.582238 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 425/836] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:29 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:30.600490 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:30.601206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:30.607812 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:30.608555 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:30.609356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:30.609797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:30.680224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:30.688078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:30.689606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:30.690744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3a532a67-2d7e-459c-97d0-b33079d2936c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1351 microversion: 2.20 time: 0.095108 Feb 07 04:22:30.691306 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 412/837] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:30 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:31.712341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:31.712952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:31.722961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:31.723773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:31.724906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:31.725437 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:31.888700 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:31.897296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:31.899925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:31.901632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-38b03e2f-909c-4d73-aa2b-e7df6c1b5a3f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.193606 Feb 07 04:22:31.902452 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 426/838] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:31 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:32.128902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-c783863c-a749-408b-b240-dcad8ca07d98 req-30fbc1d5-e5de-48a1-9f2f-fac97e349bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65197dd0-1ef5-46a4-bd5c-c4214703105b", "tag": "e0bc3bcd-e4e6-47cf-93b5-f2461a823929"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:32.130504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:32.130504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:22:32.149425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-c783863c-a749-408b-b240-dcad8ca07d98 req-30fbc1d5-e5de-48a1-9f2f-fac97e349bde service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.149901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-c783863c-a749-408b-b240-dcad8ca07d98 req-30fbc1d5-e5de-48a1-9f2f-fac97e349bde service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.162806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-c783863c-a749-408b-b240-dcad8ca07d98 req-30fbc1d5-e5de-48a1-9f2f-fac97e349bde service nova] Creating event network-changed:e0bc3bcd-e4e6-47cf-93b5-f2461a823929 for instance 65197dd0-1ef5-46a4-bd5c-c4214703105b on hv-cinder-79963 Feb 07 04:22:32.168576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-c783863c-a749-408b-b240-dcad8ca07d98 req-30fbc1d5-e5de-48a1-9f2f-fac97e349bde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047524 Feb 07 04:22:32.169890 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 427/839] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:22:32.226059 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:32.228819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:32.235148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.235665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.236505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.236985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.262297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lazy-loading 'flavor' on Instance uuid 443b0913-1482-440f-b9e3-1fb5e8012d94 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:22:32.367108 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e13fb914-3869-436c-be34-703b57eaa357 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "POST /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94/action" status: 202 len: 0 microversion: 2.1 time: 0.266208 Feb 07 04:22:32.368288 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 413/840] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:22:32 2022] POST /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:22:32.376614 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:32.377325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:32.384802 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.385375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.386393 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.387085 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.419114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:32.419715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:32.428117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.428828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.430370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.430970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.457441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:22:32.536261 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f1abcc00-2e03-4d31-b180-34f6ffa08662 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 204 len: 0 microversion: 2.1 time: 0.245161 Feb 07 04:22:32.539658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 428/841] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:22:32 2022] DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 07 04:22:32.545214 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:32.545913 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:32.552270 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.552724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.553516 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.553949 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.582610 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:32.591552 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cd647dec-b208-49fa-a81d-5a836250f995 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.218693 Feb 07 04:22:32.602054 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 414/842] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:32 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:32.645543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2bf1dc9-1886-44cd-ba90-f9ae757958a2", "device": "/dev/sdb"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:32.647236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:32.653985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.654515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.655369 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.655879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.714147 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:32.722435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e0f4eb81-addd-4f78-8fa3-3049771261f7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1580 microversion: 2.1 time: 0.181474 Feb 07 04:22:32.723017 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 429/843] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:32 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1580 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:32.921705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:32.922694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:32.928912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.929445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.931038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:32.931684 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:32.976307 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c778bce6-916c-4c14-a1f0-f3ebe78a6800 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "POST /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334878 Feb 07 04:22:32.977727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 415/844] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:22:32 2022] POST /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:22:33.087709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:33.096062 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:33.097564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:33.098719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ea87f314-27f6-4493-be3e-9238b425ce7c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.180889 Feb 07 04:22:33.099254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 430/845] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:32 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:33.609676 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:33.610273 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:33.616258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:33.616710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:33.618062 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:33.618500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:33.740313 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:33.741026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:33.747917 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:33.748404 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:33.749191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:33.749626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:33.763842 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:33.771949 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-beb83e5b-5114-4c65-9d6b-bb3b4bb8da6b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.166802 Feb 07 04:22:33.772619 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 416/846] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:33 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:33.883082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:33.890407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-78d5fa77-a6ae-41af-8619-72239f282832 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1580 microversion: 2.1 time: 0.153758 Feb 07 04:22:33.890974 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 431/847] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:33 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:34.116446 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:34.117045 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:34.123299 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:34.123747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:34.124544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:34.124976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:34.254653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:34.263154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:34.264680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:34.265769 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-53fdaa4b-c4af-4bf3-a017-24f9ade7b75f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.153069 Feb 07 04:22:34.266324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 417/848] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:34 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:34.790443 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:34.791047 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:34.797203 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:34.797648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:34.798416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:34.798848 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:34.908349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:34.908991 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:34.915780 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:34.916256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:34.917031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:34.917464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:34.934391 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:34.941686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9512c944-0ec0-4ac0-a6f5-670798dca7d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155547 Feb 07 04:22:34.942257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 432/849] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:34 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:35.051684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:35.058977 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fb0f83ca-3004-4d56-a8eb-a8539e9f8d12 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1580 microversion: 2.1 time: 0.154283 Feb 07 04:22:35.059545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 418/850] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:34 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:35.284136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:35.284994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:35.290970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:35.291467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:35.292362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:35.292819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:35.428678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:35.436855 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:35.438368 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:35.439468 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ceb86536-eb47-4d14-bdd1-f056afd0246e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.159086 Feb 07 04:22:35.440024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 433/851] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:35 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:35.959686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:35.960325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:35.967506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:35.968190 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:35.969052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:35.969491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:35.981759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-92c60a20-de0e-40de-993f-00def4fb2cbc req-9c178650-1e0d-4f23-8e0d-a19de6de0439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167dea27-bb6f-4570-bce1-655c26a20dbd", "name": "network-vif-deleted", "tag": "d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:35.983665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:35.983665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:22:35.992952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-92c60a20-de0e-40de-993f-00def4fb2cbc req-9c178650-1e0d-4f23-8e0d-a19de6de0439 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:35.993399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-92c60a20-de0e-40de-993f-00def4fb2cbc req-9c178650-1e0d-4f23-8e0d-a19de6de0439 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:36.015966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-92c60a20-de0e-40de-993f-00def4fb2cbc req-9c178650-1e0d-4f23-8e0d-a19de6de0439 service nova] Creating event network-vif-deleted:d8816f17-ae3b-42de-b3e0-5e69ddcb3f4b for instance 167dea27-bb6f-4570-bce1-655c26a20dbd on hv-cinder-79963 Feb 07 04:22:36.026862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-92c60a20-de0e-40de-993f-00def4fb2cbc req-9c178650-1e0d-4f23-8e0d-a19de6de0439 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049180 Feb 07 04:22:36.028278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 434/852] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:22:36.077087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:36.078249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:36.086767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:36.087048 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:36.091654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:36.092367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:36.186099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:36.190843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:36.196135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f4812e6b-1a61-4f25-acb5-427e4ef77234 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 200 len: 1226 microversion: 2.1 time: 0.123014 Feb 07 04:22:36.199264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0219c351-af7b-4ac7-94b7-f02ee2153652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.243181 Feb 07 04:22:36.200583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 419/853] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:35 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:36.200962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 435/854] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:36 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:36.456953 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:36.457559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:36.464234 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:36.464686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:36.465485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:36.465926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:36.598576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:36.606484 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:36.607970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:36.609127 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-09994dd8-9e0c-4ccf-9483-0dafdeec748c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.155985 Feb 07 04:22:36.609681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 420/855] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:36 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:37.216341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:37.216911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:37.217461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:37.217550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:37.223396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.223545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.223856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.223966 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.224672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.224800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.225106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.225215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.240554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:22:37.241322 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:22:37.242907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c7ca6ec1-39b6-4a86-8b76-89b8a7705f98 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.029523 Feb 07 04:22:37.243890 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 421/856] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:37 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 07 04:22:37.291170 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-214231150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1983533653", "security_groups": [{"name": "tempest-secgroup-smoke-1039050704"}], "block_device_mapping_v2": [{"uuid": "ec740df2-7003-4c33-a9b3-445c5630e783", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2380dba0-88cd-40c3-a56d-3005ce2546c4"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:37.374779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:37.382345 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4659566a-3522-40d2-8b98-15cdef8c8e91 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.169680 Feb 07 04:22:37.382921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 436/857] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:37 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:37.401972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] validate_networks() for [('2380dba0-88cd-40c3-a56d-3005ce2546c4', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:22:37.626268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:37.626876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:37.632581 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.633066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.633844 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.634279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.764482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:37.765543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:22:37.765966 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:22:37.766442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:22:37.766851 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:22:37.767265 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:22:37.772198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:37.774253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:37.775614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f814a39b-d578-499c-ae62-87fd2405b591 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.152805 Feb 07 04:22:37.776199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 437/858] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:37 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:22:37.777255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.777699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.778508 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:37.779167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:37.795489 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:22:37.799304 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Getting quotas for user 5af228b237eb4e93baf30ade75bdca98 and project 50ebc5dbe4c54633a6605d9a54949953. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:22:37.852506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:22:37.854651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec740df2-7003-4c33-a9b3-445c5630e783',volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:22:37.978610 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-38dc07b7-7ff2-480c-ac73-e38e20c7483d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.691598 Feb 07 04:22:37.979885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 422/859] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:22:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 07 04:22:37.989433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-782d44fc-d181-405f-879d-c52807c094cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:37.990046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-782d44fc-d181-405f-879d-c52807c094cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:38.041359 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-782d44fc-d181-405f-879d-c52807c094cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:38.047702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-782d44fc-d181-405f-879d-c52807c094cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1094 microversion: 2.1 time: 0.061834 Feb 07 04:22:38.048299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 438/860] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:37 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:38.398850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:38.400306 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:38.408931 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:38.409522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:38.410488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:38.411029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:38.559994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:38.568033 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b36e5889-7315-4eaf-aed2-434bc9e81421 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.172928 Feb 07 04:22:38.578027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 423/861] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:38 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:38.794460 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:38.795067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:38.801262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:38.801711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:38.802475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:38.802906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:38.940284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:38.948197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:38.949690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:38.950813 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c89a7fb9-c3ad-4680-a17a-b69c082febc1 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.160269 Feb 07 04:22:38.951370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 439/862] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:38 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:39.064327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:39.065088 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:39.071150 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:39.071717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:39.072624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:39.073584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:39.142901 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:39.151204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8aae1d30-c654-41f4-ad9f-37f36899093d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1210 microversion: 2.1 time: 0.090560 Feb 07 04:22:39.151771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 424/863] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:39 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:39.585592 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:39.586841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:39.592651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:39.593105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:39.593880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:39.594317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:39.749947 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:39.758333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bca60c8e-4c88-4acd-a524-e524be632600 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.175863 Feb 07 04:22:39.759219 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 440/864] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:39 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:39.968434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:39.969046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:39.975182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:39.975632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:39.976464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:39.976900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:40.168194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:40.168809 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:40.174886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:40.175332 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:40.176132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:40.176663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:40.183140 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:40.191141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:40.192854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:40.194357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f9330e6c-c6e4-4ed9-95fd-c9f7e4e410f4 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.229566 Feb 07 04:22:40.194894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 425/865] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:39 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:40.340985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:40.348927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-395698ae-98a1-4e2a-b8a7-0553575b30b1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1278 microversion: 2.1 time: 0.183848 Feb 07 04:22:40.349716 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 441/866] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:40 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:40.486881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-061e23a1-5da6-49f9-a8ad-ef05380f685b req-6f8aef25-357b-4e11-9b7a-1d07759a2342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b7e502-8196-48b1-a7ad-77ec28c6dbad", "tag": "23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:40.496855 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:40.496855 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:22:40.514531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-061e23a1-5da6-49f9-a8ad-ef05380f685b req-6f8aef25-357b-4e11-9b7a-1d07759a2342 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:40.515825 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-061e23a1-5da6-49f9-a8ad-ef05380f685b req-6f8aef25-357b-4e11-9b7a-1d07759a2342 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:40.538502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-061e23a1-5da6-49f9-a8ad-ef05380f685b req-6f8aef25-357b-4e11-9b7a-1d07759a2342 service nova] Creating event network-changed:23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca for instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad on hv-cinder-79963 Feb 07 04:22:40.546649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-061e23a1-5da6-49f9-a8ad-ef05380f685b req-6f8aef25-357b-4e11-9b7a-1d07759a2342 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063316 Feb 07 04:22:40.548409 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 426/867] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:22:40.774474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:40.775090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:40.781345 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:40.781820 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:40.782748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:40.783260 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:40.923608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:40.931478 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-32fac2c9-fcf9-4cdf-8eab-bcf3c17f6efc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.160671 Feb 07 04:22:40.932061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 442/868] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:40 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:41.214542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:41.215245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:41.221207 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:41.221661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:41.222449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:41.222891 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:41.365281 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:41.365901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:41.372117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:41.372577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:41.373370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:41.373812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:41.430696 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:41.439401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:41.441063 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:41.442318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9eecf187-6f80-43c5-8135-c45cb094ceaa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.232469 Feb 07 04:22:41.442878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 427/869] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:41 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:41.509852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:41.517012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c2d4d416-4304-4b6e-9f5e-959cd85c6f52 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1278 microversion: 2.1 time: 0.155370 Feb 07 04:22:41.517582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 443/870] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:41 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:41.947768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:41.948412 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:41.954291 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:41.954741 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:41.955514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:41.955950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:42.086329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:42.093507 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bfd695bb-8488-4e12-9cb5-60ef349c297d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.149885 Feb 07 04:22:42.094095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 428/871] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:42.459880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:42.460509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:42.466726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:42.467168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:42.467929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:42.468388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:42.533627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:42.534231 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:42.541043 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:42.541493 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:42.542420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:42.542701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:42.602179 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:42.612752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:42.614249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:42.615346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8dd71d59-5979-486a-9132-4ec839cf2779 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.159165 Feb 07 04:22:42.615899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 444/872] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:42 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:42.685979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:42.693105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4a3926ab-2140-41f1-bdaf-5e6b2816069d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1278 microversion: 2.1 time: 0.163121 Feb 07 04:22:42.693664 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 429/873] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:42 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:43.110119 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:43.110659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:43.116694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.117145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.117918 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.118427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.248716 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:43.255951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-79098060-a039-4e62-b034-c58592ed1d92 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.149517 Feb 07 04:22:43.256547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 445/874] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:43 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:43.450351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-e96f3132-5511-41aa-81b8-696aae3259d4 req-b1d6737f-566e-4e8c-8e74-054a7f29bab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65197dd0-1ef5-46a4-bd5c-c4214703105b", "name": "network-vif-plugged", "status": "completed", "tag": "e0bc3bcd-e4e6-47cf-93b5-f2461a823929"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:43.451940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:43.451940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:22:43.459115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-e96f3132-5511-41aa-81b8-696aae3259d4 req-b1d6737f-566e-4e8c-8e74-054a7f29bab9 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.459576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-e96f3132-5511-41aa-81b8-696aae3259d4 req-b1d6737f-566e-4e8c-8e74-054a7f29bab9 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.471063 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-e96f3132-5511-41aa-81b8-696aae3259d4 req-b1d6737f-566e-4e8c-8e74-054a7f29bab9 service nova] Creating event network-vif-plugged:e0bc3bcd-e4e6-47cf-93b5-f2461a823929 for instance 65197dd0-1ef5-46a4-bd5c-c4214703105b on hv-cinder-79963 Feb 07 04:22:43.475809 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-e96f3132-5511-41aa-81b8-696aae3259d4 req-b1d6737f-566e-4e8c-8e74-054a7f29bab9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029689 Feb 07 04:22:43.476434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 430/875] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:22:43.633864 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:43.635099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:43.641383 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.641834 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.642617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.643058 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.711139 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:43.711877 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:43.718034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.718563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.719355 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:43.719824 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:43.779869 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:43.788107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:43.789734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:43.790856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fd9196c6-3701-45c3-a497-70b31277dec9 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.160769 Feb 07 04:22:43.800370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 446/876] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:43 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:22:43.858300 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:43.865443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e35e9827-8c25-4e75-81b2-9866486845bd tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1278 microversion: 2.1 time: 0.158775 Feb 07 04:22:43.866002 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 431/877] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:43 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:44.273473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:44.274007 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:44.280635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:44.281082 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:44.281850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:44.282278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:44.419828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:44.427110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7d4cda49-d260-471c-b920-5df32942b975 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.157361 Feb 07 04:22:44.427669 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 447/878] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:44 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:44.807876 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:44.808630 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:44.814813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:44.815264 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:44.816083 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:44.816592 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:44.882208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:44.882897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:44.889551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:44.890005 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:44.890791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:44.891253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:45.035197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:45.042967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-69eb3402-deff-49c0-bd28-7687cf577b73 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1278 microversion: 2.1 time: 0.164435 Feb 07 04:22:45.043558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 448/879] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:44 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:45.199998 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:45.207700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:45.209436 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:45.210559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-61d750e5-3f6c-408f-84f8-c37ee74424aa tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.406337 Feb 07 04:22:45.211107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 432/880] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:44 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:45.444059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:45.444698 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:45.450433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:45.450816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:45.451580 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:45.452011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:45.588595 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:45.595797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3150644b-c04e-4be5-a54e-c6ad2cba077f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155584 Feb 07 04:22:45.596385 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 449/881] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:45 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:46.059772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:46.060349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:46.066712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:46.067172 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:46.068001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:46.068469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:46.204970 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:46.213939 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4e117689-f87f-4c6f-98e8-6abb798d58a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1278 microversion: 2.1 time: 0.157937 Feb 07 04:22:46.221523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 433/882] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:46 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:46.228243 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:46.228866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:46.235147 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:46.235605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:46.236425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:46.236893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:46.370805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:46.378541 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:46.380069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:46.381172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-cb0c5620-237b-4984-a69a-191f342a40c0 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.156813 Feb 07 04:22:46.381734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 450/883] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:46 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:46.613197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:46.613721 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:46.620803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:46.621463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:46.622246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:46.622684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:46.754256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:46.761990 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-07e3aa57-cdef-4375-9c76-3f1db53d7e54 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152575 Feb 07 04:22:46.762550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 434/884] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:46 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:47.230978 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:47.231517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:47.237721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:47.238202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:47.238969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:47.239401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:47.378110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:47.385321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a75ce1f2-b5b7-4c25-9f6c-22dbb845b9a6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.158603 Feb 07 04:22:47.385879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 451/885] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:47 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:47.400081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:47.400938 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:47.407289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:47.407765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:47.408567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:47.409037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:47.536083 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:47.544473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:47.545961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:47.547035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-071d417e-121a-410e-95e2-25fec1b8265c tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.151177 Feb 07 04:22:47.547590 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 435/886] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:47 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:47.779442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:47.780000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:47.786210 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:47.786659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:47.787435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:47.787879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:47.916879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:47.924099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b6529c43-1cbb-4147-857c-c955616c9280 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.149236 Feb 07 04:22:47.924665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 452/887] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:47 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:48.402573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:48.403206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:48.409341 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:48.409790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:48.410559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:48.410990 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:48.544453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:48.551684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-030c15fd-36bf-4323-979b-e05b8810102f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.153042 Feb 07 04:22:48.552283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 436/888] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:48.564275 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:48.564887 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:48.570995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:48.571457 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:48.572276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:48.572713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:48.702876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:48.710532 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:48.712035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:48.713162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d78cf436-b36f-4f90-ac9c-5b0538a28c84 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.152540 Feb 07 04:22:48.713721 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 453/889] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:48 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:48.940899 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:48.941682 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:48.947472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:48.947919 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:48.948715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:48.949150 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:49.087844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:49.095110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-141990bc-d00e-4de8-bae7-5d29a483bad4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.157914 Feb 07 04:22:49.095669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 437/890] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:48 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:49.568927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:49.569569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:49.576379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:49.576831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:49.577605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:49.578042 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:49.706924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:49.714182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e98cfb41-cea3-4483-b185-0ec84c937bd2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.148881 Feb 07 04:22:49.714746 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 454/891] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:49 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:49.730373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:49.730983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:49.737148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:49.737596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:49.738371 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:49.738811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:49.873907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:49.881829 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:49.883360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:49.885142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-27ac26f7-7476-4db5-bcce-8a82ae3a928e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.158460 Feb 07 04:22:49.885686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 438/892] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:49 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:50.114314 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:50.114954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:50.121432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:50.121902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:50.122670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:50.123104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:50.251771 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:50.259586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-302fbba2-4fc5-4c1f-b375-c418aa9b0c0c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.148394 Feb 07 04:22:50.260193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 455/893] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:50 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:50.731224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:50.731836 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:50.738060 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:50.738513 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:50.739384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:50.739821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:50.871267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:50.878871 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-69f23ed6-b931-497c-91fc-59e21122b299 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.151955 Feb 07 04:22:50.879439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 439/894] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:50 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:50.904393 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:50.905000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:50.911758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:50.912335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:50.913131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:50.913562 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:51.047445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:51.055170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:51.056736 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:51.057840 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8b09cb6a-2646-4706-9b59-fe38f518a71e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.159468 Feb 07 04:22:51.058394 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 456/895] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:50 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:51.277018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:51.277613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:51.283361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:51.283814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:51.284644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:51.285082 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:51.425564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:51.432855 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-855c0887-9b1a-416a-aaf6-1e5626f8fdef tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.160428 Feb 07 04:22:51.433445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 440/896] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:51 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:51.895448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:51.896461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:51.902932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:51.903380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:51.904194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:51.904659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:52.039156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:52.047028 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f13f0a4d-9919-4f0d-b113-aa2283da4723 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.155421 Feb 07 04:22:52.047595 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 457/897] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:51 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:52.075961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:52.076579 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:52.082636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:52.083077 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:52.083848 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:52.084303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:52.315644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:52.324775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:52.326386 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:52.327436 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b52cda10-b36f-46c1-b2b7-d8b3fa2c44f2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1406 microversion: 2.20 time: 0.255722 Feb 07 04:22:52.328402 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 441/898] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:52 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:52.449666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:52.450285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:52.456010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:52.456492 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:52.457264 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:52.457699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:52.592706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:52.600072 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1481b735-2d85-4ea6-8cfc-32c704188cf7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154091 Feb 07 04:22:52.600654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 458/899] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:52 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:53.064449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:53.065060 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:53.070905 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.071862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.072673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.073112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.205628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:53.215415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1ec8ca3d-afd1-4feb-be78-afd8ec1d104b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.154510 Feb 07 04:22:53.215983 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 442/900] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:53 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:53.344861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:53.346197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:53.352825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.353272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.354055 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.354488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.490087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:53.498608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:53.500124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:53.501262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-41d4c726-9e1a-467f-900c-69aab877c803 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1598 microversion: 2.20 time: 0.160066 Feb 07 04:22:53.501815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 459/901] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:53 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 07 04:22:53.518905 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:53.519506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:53.525517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.526195 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.527001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.527415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.617503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:53.618765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:53.620138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-12be9c05-ba04-4f50-9d80-e6111edea9a3 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104913 Feb 07 04:22:53.620797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 443/902] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Feb 7 04:22:53 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 07 04:22:53.624887 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.625426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:53.626215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:53.626885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:54.133657 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:54.140921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a949af9d-d98b-4f6f-a007-5c8737005023 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.527274 Feb 07 04:22:54.141491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 460/903] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:53 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:54.233808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:54.234424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:54.240253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:54.240710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:54.241498 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:54.241925 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:54.377289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:54.384622 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e19862b8-ea04-4e1f-910e-0243905b7b56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.154905 Feb 07 04:22:54.385380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 444/904] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:54 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:54.820402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:54.821020 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:54.828064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:54.828528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:54.829319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:54.829758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:54.878310 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-78a6e811-b782-4dfd-b3a6-bbdc09715f01 req-8a0be4ba-fdf7-4803-89b3-e4fcb7a15acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65197dd0-1ef5-46a4-bd5c-c4214703105b", "tag": "e0bc3bcd-e4e6-47cf-93b5-f2461a823929"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:54.879881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:54.879881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:22:54.887441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-78a6e811-b782-4dfd-b3a6-bbdc09715f01 req-8a0be4ba-fdf7-4803-89b3-e4fcb7a15acb service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:54.887886 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-78a6e811-b782-4dfd-b3a6-bbdc09715f01 req-8a0be4ba-fdf7-4803-89b3-e4fcb7a15acb service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:54.898957 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-78a6e811-b782-4dfd-b3a6-bbdc09715f01 req-8a0be4ba-fdf7-4803-89b3-e4fcb7a15acb service nova] Creating event network-changed:e0bc3bcd-e4e6-47cf-93b5-f2461a823929 for instance 65197dd0-1ef5-46a4-bd5c-c4214703105b on hv-cinder-79963 Feb 07 04:22:54.911467 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-78a6e811-b782-4dfd-b3a6-bbdc09715f01 req-8a0be4ba-fdf7-4803-89b3-e4fcb7a15acb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091847 Feb 07 04:22:54.912095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 445/905] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:22:54.982879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:54.991025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:54.992869 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:54.994929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b7e21b15-cd49-4dab-a42a-4f2ccdad3bb7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1598 microversion: 2.20 time: 0.178230 Feb 07 04:22:54.995661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 461/906] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:54 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:55.158881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:55.159580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:55.166648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:55.166648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:55.167429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:55.167862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:55.388869 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:55.398345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-62336b4d-6380-4b52-ab63-74b9dd88b3b9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.243421 Feb 07 04:22:55.398911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 446/907] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:55 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:55.401018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:55.401493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:55.409224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:55.409679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:55.410471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:55.410911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:55.551056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:55.558890 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e5a46749-3f6f-4b3c-992e-e9540573d10c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.161833 Feb 07 04:22:55.560081 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 462/908] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:55 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:56.014219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:56.014789 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:56.020777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.021228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.022011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.022455 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.156775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:56.164412 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:56.165959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9140d220db624cf89b9e010215040eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafc4147461248299eee9b97ebd42995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:56.167108 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9d572ccc-1705-4a22-a41f-9a44fe396b2f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 200 len: 1717 microversion: 2.20 time: 0.156974 Feb 07 04:22:56.167667 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 447/909] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:22:56 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 07 04:22:56.184232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:56.184842 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:56.191061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.191511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.192319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.192757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.216106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-94877d1c-5585-4be7-a463-605f7bf09772 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b/ips" status: 200 len: 152 microversion: 2.20 time: 0.035509 Feb 07 04:22:56.216659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 463/910] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Feb 7 04:22:56 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 07 04:22:56.415291 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:56.415917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:56.425942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.426373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.427435 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.428136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.566416 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:56.574241 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-de73b1b7-b970-4db6-a39d-71c3967c396e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.163311 Feb 07 04:22:56.574805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 448/911] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:56 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:56.575770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:56.576428 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:56.582366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.582837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.583600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:56.584030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:56.717282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:56.724393 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b7847b41-f91f-491b-8793-4b6e27186f3d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152762 Feb 07 04:22:56.724955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 464/912] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:56 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:57.591545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:57.592173 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:57.598305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:57.598751 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:57.599525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:57.599950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:57.732735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:57.740080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d08083f6-391a-4cc2-8f52-a11550481b96 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152128 Feb 07 04:22:57.740850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 449/913] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:57 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:57.741378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:57.741998 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:57.748444 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:57.748909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:57.749722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:57.750163 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:57.884964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:57.892180 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3288c3c0-cce7-42b4-96f5-4081a24c3051 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.154499 Feb 07 04:22:57.892740 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 465/914] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:57 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:22:58.757401 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:58.758013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:58.764209 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:58.764670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:58.765449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:58.765881 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:58.834884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-866a3ca6-704b-4836-a724-0f43d12ba586 req-1a783a0c-01c4-42f4-b29a-2f4338ad1c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443b0913-1482-440f-b9e3-1fb5e8012d94", "name": "network-vif-unplugged", "status": "completed", "tag": "17109406-6d8f-40f6-9417-ddb7abe58df8"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:22:58.837278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:22:58.837278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:22:58.850439 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-866a3ca6-704b-4836-a724-0f43d12ba586 req-1a783a0c-01c4-42f4-b29a-2f4338ad1c88 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:58.851178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-866a3ca6-704b-4836-a724-0f43d12ba586 req-1a783a0c-01c4-42f4-b29a-2f4338ad1c88 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:58.864638 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-866a3ca6-704b-4836-a724-0f43d12ba586 req-1a783a0c-01c4-42f4-b29a-2f4338ad1c88 service nova] Creating event network-vif-unplugged:17109406-6d8f-40f6-9417-ddb7abe58df8 for instance 443b0913-1482-440f-b9e3-1fb5e8012d94 on hv-cinder-79963 Feb 07 04:22:58.870697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-866a3ca6-704b-4836-a724-0f43d12ba586 req-1a783a0c-01c4-42f4-b29a-2f4338ad1c88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039440 Feb 07 04:22:58.872489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 466/915] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:22:58.905432 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:58.909557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:58.910261 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:58.912990 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8b0dffbe-afde-4eb5-b1c8-b4076b9cb727 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.159243 Feb 07 04:22:58.913559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 450/916] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:58 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:58.917361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:58.917880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:58.918742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:58.919310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:59.053086 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:22:59.064194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8128432c-8adc-47dc-b32b-a4dd329a5af4 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.158277 Feb 07 04:22:59.065064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 467/917] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:58 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:22:59.931126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:22:59.931729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:22:59.938371 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:59.938830 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:22:59.939626 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:22:59.940096 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:00.081853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:00.087963 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:00.089680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:00.089845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c145fd70-c1c7-4729-8825-40d50b9dc441 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.162993 Feb 07 04:23:00.090422 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 451/918] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:22:59 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:00.096773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:00.097230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:00.098046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:00.098485 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:00.233076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:00.240264 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6faaee08-be48-44a2-b0a5-2023975cc1c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.158914 Feb 07 04:23:00.240822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 468/919] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:00 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:01.106552 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:01.107158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:01.113344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:01.113790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:01.114557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:01.114984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:01.250989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:01.256276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:01.256944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:01.258723 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-573eeeac-9860-4c01-bb7e-ecf1f29eecda tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155806 Feb 07 04:23:01.259327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 452/920] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:01 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:01.263381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:01.263864 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:01.264679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:01.265124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:01.397542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:01.405185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-efd405ba-0c30-4d74-b9c1-22267d72de34 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152411 Feb 07 04:23:01.406189 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 469/921] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:01 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:02.275611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:02.276253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:02.282859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:02.283311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:02.284104 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:02.284544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:02.414202 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:02.421575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-725870f2-2238-45a2-a369-e5b59ff657c1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150321 Feb 07 04:23:02.422145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 453/922] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:02 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:02.425077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:02.425691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:02.432435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:02.432889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:02.433665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:02.434101 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:02.569557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:02.577601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ec743bad-c63f-465b-94c9-764134eb3e4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.156159 Feb 07 04:23:02.578157 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 470/923] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:02 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:03.438551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:03.439184 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:03.445570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:03.446522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:03.447295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:03.447729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:03.580326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:03.588216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e5de2b58-9d0f-49f8-adcb-88c75660005b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153323 Feb 07 04:23:03.597488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 454/924] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:03 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:03.597971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:03.597971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:03.600889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:03.601347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:03.602136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:03.602568 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:03.731811 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:03.739073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1b2bbf3f-7d45-484d-acbe-5b48b904f988 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.148814 Feb 07 04:23:03.740095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 471/925] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:03 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:04.605724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:04.606359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:04.612569 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:04.613034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:04.613783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:04.614326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:04.755524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:04.756192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:04.762440 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:04.762895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:04.763682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:04.764164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:04.821469 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:04.837962 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0670d227-2443-4f38-b876-2f792bb11577 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.236297 Feb 07 04:23:04.838615 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 455/926] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:04 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:04.903420 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:04.910845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7108c061-0572-48ce-9700-65e5157118cf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.159063 Feb 07 04:23:04.911633 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 472/927] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:04 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:05.854729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:05.855344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:05.861523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:05.861973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:05.862752 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:05.863186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:05.929033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:05.929561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:05.936358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:05.936810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:05.937588 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:05.938020 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:06.003388 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:06.011364 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cb683d40-fdb7-403f-951a-2e701b0c1974 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.160630 Feb 07 04:23:06.011951 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 456/928] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:05 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:06.223558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:06.231469 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-412174e6-7be3-49ee-96b5-188537066b4a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.306275 Feb 07 04:23:06.232024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 473/929] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:05 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:07.028572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:07.029181 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:07.035567 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:07.036015 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:07.036823 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:07.037252 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:07.176188 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:07.184113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7f229247-3493-4902-901d-6e9e0a5ebad6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.159401 Feb 07 04:23:07.184681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 457/930] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:07 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:07.248197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:07.248815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:07.255014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:07.255463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:07.256289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:07.256727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:07.387773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:07.398257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-aba5e704-b39d-4f04-aa5c-8e5707ea5bb0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.153674 Feb 07 04:23:07.398815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 474/931] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:07 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:08.201300 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:08.201816 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:08.208124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:08.208577 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:08.209353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:08.209787 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:08.342533 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:08.349724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-50ff8436-66b7-4e38-aa2c-b2977f2c98f8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152242 Feb 07 04:23:08.350287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 458/932] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:08 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:08.414262 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:08.414905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:08.421161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:08.421615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:08.422401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:08.422841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:08.555980 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:08.563202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-07a16040-617a-416a-8a8e-fc31cc087104 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152550 Feb 07 04:23:08.563756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 475/933] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:08 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:09.019156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:23:09.019323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:23:09.366382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:09.366902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:09.373153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:09.373598 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:09.374361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:09.374791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:09.503565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:09.511217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-298befca-561c-4605-8984-101ed4d06a35 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.148599 Feb 07 04:23:09.511773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 459/934] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:09 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:09.580142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:09.580760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:09.587003 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:09.587459 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:09.588918 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:09.589355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:09.719986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:09.727592 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-da9555e3-a124-412c-9ec3-47fd6e8b87d1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.151114 Feb 07 04:23:09.728352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 476/935] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:09 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:10.528248 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:10.528854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:10.535046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:10.535443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:10.536304 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:10.536746 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:10.669786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:10.676965 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-20b7ba90-ec3f-4d0f-8c72-ca040bb371d6 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153179 Feb 07 04:23:10.677528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 460/936] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:10 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:10.744706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:10.745328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:10.751573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:10.752038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:10.752868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:10.753309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:10.890277 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:10.897500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d1191909-3104-4fd5-8efe-1e61e7bf1079 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.156489 Feb 07 04:23:10.898062 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 477/937] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:10 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:11.693832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:11.694439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:11.700649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:11.701092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:11.701858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:11.702290 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:11.832847 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:11.840150 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-531d1ff9-042a-4ca5-9907-f91bfab5766c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150006 Feb 07 04:23:11.840722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 461/938] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:11 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:11.914809 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:11.915431 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:11.922204 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:11.922664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:11.923479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:11.923923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:12.054357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:12.061602 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-12476f54-aff9-47ee-9974-af011a9e9e56 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.150531 Feb 07 04:23:12.062184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 478/939] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:11 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:12.856420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:12.857025 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:12.863141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:12.863585 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:12.864382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:12.864811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:12.999286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:13.006608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7ae2fca7-54e9-4c7b-9254-da973d459340 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153835 Feb 07 04:23:13.007267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 462/940] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:12 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:13.078511 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:13.079054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:13.085280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:13.085738 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:13.086529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:13.086967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:13.219764 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:13.227056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b96b0d65-4b88-4979-9489-7770bcd9a8b3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152922 Feb 07 04:23:13.227603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 479/941] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:13 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:14.023528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:14.024167 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:14.031709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:14.032220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:14.033010 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:14.033484 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:14.172691 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:14.179950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1b945624-59ae-45d5-9a17-bde83a0e718d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.160092 Feb 07 04:23:14.180544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 463/942] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:14 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:14.244352 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:14.244969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:14.251604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:14.252075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:14.252876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:14.253317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:14.387916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:14.396531 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-58e6ea8a-dec2-43e2-8c5e-36ac6978c983 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.155724 Feb 07 04:23:14.397100 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 480/943] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:14 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:15.197368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:15.197986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:15.204235 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:15.204691 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:15.205479 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:15.205919 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:15.340441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:15.347656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a09b8195-aa49-477a-beb2-2d756a8b555f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154000 Feb 07 04:23:15.348254 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 464/944] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:15 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:15.413408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:15.414018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:15.420346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:15.420854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:15.421633 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:15.422066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:15.553475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:15.561235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b689cfd3-1a01-4dbb-9e40-13e04218416b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152271 Feb 07 04:23:15.561786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 481/945] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:15 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:16.364239 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:16.364847 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:16.370985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:16.371429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:16.372220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:16.372653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:16.510210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:16.518029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ca06c552-158c-4e4a-8a5b-b63617b4a68c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.157421 Feb 07 04:23:16.518604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 465/946] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:16 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:16.577872 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:16.578420 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:16.584681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:16.585130 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:16.585995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:16.586432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:16.718450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:16.725741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f2b0401e-190d-48bd-b5ee-86958e862186 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152197 Feb 07 04:23:16.726327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 482/947] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:16 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:17.534526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:17.535138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:17.541367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:17.541816 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:17.542594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:17.543647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:17.671921 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:17.679250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-90af5a8a-abf4-40ca-8505-02df07320a87 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.148349 Feb 07 04:23:17.679814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 466/948] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:17 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:17.745042 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:17.745652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:17.751783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:17.752282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:17.753060 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:17.753500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:17.883576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:17.896861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a663c385-a0e3-4965-b73b-407e169d32f0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.155423 Feb 07 04:23:17.897446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 483/949] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:17 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:18.696461 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:18.696982 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:18.703196 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:18.703656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:18.704464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:18.704908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:18.837870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:18.845621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-04c91d95-8745-4677-869f-ea1bcb623ed9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152947 Feb 07 04:23:18.846191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 467/950] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:18 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:18.913915 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:18.914534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:18.921530 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:18.921981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:18.922758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:18.923195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:19.058836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:19.066039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-671bc9ad-1560-451d-a525-562531d07824 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.155824 Feb 07 04:23:19.066604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 484/951] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:18 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:19.862219 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:19.862839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:19.869177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:19.869629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:19.870410 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:19.871460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:20.002800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:20.013022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8dab3314-bf1a-4fb8-bd81-fe2e9b5298cc tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154150 Feb 07 04:23:20.013425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 468/952] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:19 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:20.082853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:20.083399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:20.089618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:20.090071 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:20.090844 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:20.091281 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:20.225930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:20.233282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-390ea222-bdcd-4328-b5bf-d04aa332a93c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.154123 Feb 07 04:23:20.233832 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 485/953] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:20 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:21.030370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:21.030979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:21.037170 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:21.037623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:21.038404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:21.038839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:21.177684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:21.184997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-55989e3d-4458-44a7-ad51-d05cec9f7ea0 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.158752 Feb 07 04:23:21.185578 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 469/954] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:21 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:21.249818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:21.250375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:21.256620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:21.257078 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:21.257863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:21.258312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:21.389333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:21.396668 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ae4fa5ad-cf87-4e1c-9b57-d270ea6080f8 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.150571 Feb 07 04:23:21.397233 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 486/955] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:21 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:22.201218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:22.201834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:22.208000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:22.208476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:22.209382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:22.209832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:22.349528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:22.356932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-28f60b7a-a19e-4aab-907c-023ecfce8f56 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.159877 Feb 07 04:23:22.357505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 470/956] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:22 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:22.413951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:22.414558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:22.420794 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:22.421245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:22.422024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:22.422473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:22.557331 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:22.565176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a153d102-23b8-4079-bd56-bab54a32343b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.154913 Feb 07 04:23:22.565735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 487/957] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:22 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:23.373511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:23.374120 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:23.380313 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:23.380761 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:23.381528 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:23.381956 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:23.509321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:23.516424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a42265f8-4938-4ecb-9c88-4ec849231d3a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.146512 Feb 07 04:23:23.516993 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 471/958] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:23 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:23.581217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:23.581835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:23.588014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:23.588506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:23.589292 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:23.589737 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:23.720869 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:23.727962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b89342eb-33a0-4c66-bcee-3d684351ab19 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.150421 Feb 07 04:23:23.728548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 488/959] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:23 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:24.533507 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:24.534129 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:24.540603 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:24.541056 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:24.541835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:24.542272 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:24.676437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:24.683765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a35f752c-7cf8-46a7-8e75-5fbab6e52904 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154005 Feb 07 04:23:24.684953 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 472/960] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:24 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:24.744059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:24.744715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:24.750943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:24.751389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:24.752192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:24.752634 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:24.886118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:24.893209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-72a3ed28-9c34-4d68-96d8-b131f74d6510 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152764 Feb 07 04:23:24.893756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 489/961] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:24 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:25.700712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:25.701327 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:25.707526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:25.707979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:25.708791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:25.709231 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:25.840616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:25.848478 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4e360d52-c5f7-44fd-8719-83db6e6422a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151319 Feb 07 04:23:25.849047 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 473/962] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:25 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:25.910083 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:25.910697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:25.916888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:25.917344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:25.918124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:25.918565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:26.048589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:26.055789 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4f11fb51-956a-4ccb-bed7-54e528491e57 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.149352 Feb 07 04:23:26.056389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 490/963] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:25 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:26.864986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:26.865594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:26.871920 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:26.872415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:26.873188 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:26.873624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:27.007627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:27.015686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-45dbea67-4c13-48bc-b207-c8b9512fcbc4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154361 Feb 07 04:23:27.016356 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 474/964] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:26 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:27.072285 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:27.072903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:27.079360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:27.079820 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:27.080712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:27.081155 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:27.210847 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:27.218195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ec7ec21e-ade9-44e2-bd88-f7a39136236f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.149576 Feb 07 04:23:27.218758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 491/965] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:27 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:28.033321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:28.033887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:28.040162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:28.040617 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:28.041398 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:28.041838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:28.173192 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:28.180368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-8da3f8f7-8c5f-4d60-a2ee-f6a12ff35021 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150779 Feb 07 04:23:28.180940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 475/966] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:28 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:28.234582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:28.235208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:28.241466 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:28.241921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:28.242703 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:28.243145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:28.378859 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:28.386067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e65da6a1-3344-40d5-9b86-72760cd72867 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.155242 Feb 07 04:23:28.386635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 492/967] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:28 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:29.196887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:29.197523 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:29.203452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:29.203893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:29.204686 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:29.205117 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:29.339258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:29.347063 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0fb6a67f-9a29-402d-99ee-d0334e5d7c3d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153669 Feb 07 04:23:29.347636 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 476/968] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:29 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:29.403519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:29.404176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:29.410438 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:29.410893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:29.411675 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:29.412144 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:29.543065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:29.550992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-41a1ad4e-0a8a-4711-ae12-fb82e3c2591b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.151911 Feb 07 04:23:29.551550 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 493/969] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:29 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:30.364255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:30.364856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:30.371018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:30.371464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:30.372904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:30.373335 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:30.536939 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:30.544176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-688c74d1-04ae-4499-8d69-bc8da3490b84 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.183609 Feb 07 04:23:30.544747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 477/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:30 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:30.566310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:30.566927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:30.573173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:30.573626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:30.574406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:30.575356 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:30.715465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:30.722642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a9732007-d053-44e1-8f43-1d3550fa120f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.159977 Feb 07 04:23:30.723200 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 494/971] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:30 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:31.561024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:31.561546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:31.568977 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:31.569730 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:31.571105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:31.571877 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:31.701858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:31.709163 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5c3c230c-98f7-4cf2-a684-90aa0c67f302 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151941 Feb 07 04:23:31.709734 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 478/972] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:31 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:31.738704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:31.739348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:31.745479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:31.745931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:31.746699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:31.747133 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:31.880231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:31.888020 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-aa9ae690-e23e-418f-a527-cf00de914bde tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152522 Feb 07 04:23:31.888601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 495/973] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:31 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:32.726214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:32.726815 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:32.733605 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:32.734053 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:32.734818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:32.735246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:32.782232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:32.782775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:32.789287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:32.789672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:32.790453 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:32.790897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:32.867444 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lazy-loading 'services' on Instance uuid 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:23:32.871393 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:32.879453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-adb14a18-1239-45e8-b954-b3343667e2ab tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.156830 Feb 07 04:23:32.880028 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 479/974] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:32 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:32.904807 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:32.905420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:32.911124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:32.911576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:32.912405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:32.912869 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:32.938131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c71edf06-de8e-45e7-a6e3-c1691513f568 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments/0f6557c6-28fa-4cfb-887a-ac61c3749e96" status: 202 len: 0 microversion: 2.1 time: 0.159440 Feb 07 04:23:32.938706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 496/975] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:23:32 2022] DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments/0f6557c6-28fa-4cfb-887a-ac61c3749e96 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 07 04:23:33.063216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:33.070502 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0aabe216-9fcb-4785-a21b-4b9634c434c3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.169529 Feb 07 04:23:33.071057 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 480/976] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:32 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:33.896950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:33.897686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:33.904666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:33.905115 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:33.906372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:33.906372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:34.050333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:34.057671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-190f6209-fc20-4089-a4a0-ae4d6a5611ae tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.165231 Feb 07 04:23:34.058228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 497/977] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:33 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:34.086318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:34.086927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:34.093821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:34.094305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:34.095118 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:34.095554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:34.228543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:34.235675 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-271d9f8b-22eb-4872-bd16-380b31cf42af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.153032 Feb 07 04:23:34.236268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 481/978] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:34 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:35.074341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:35.074950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:35.081469 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:35.081931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:35.082720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:35.083169 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:35.218865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:35.226016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2e3f2a18-28fa-4c3f-9b76-dc20938d3405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155383 Feb 07 04:23:35.226593 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 498/979] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:35 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:35.251910 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:35.252609 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:35.258833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:35.259289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:35.260095 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:35.260538 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:35.395639 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:35.403077 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-11f44ed4-08ab-43de-b4fa-132909316baf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.154814 Feb 07 04:23:35.404157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 482/980] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:35 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:36.243657 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:36.244338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:36.251061 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:36.251514 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:36.252328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:36.252768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:36.383850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:36.391338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-17f09fa9-288f-4989-ab98-3023283ec90a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151350 Feb 07 04:23:36.391900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 499/981] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:36 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:36.420370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:36.421081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:36.428102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:36.428563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:36.429358 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:36.429803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:36.558220 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:36.566050 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9b60b6b5-b1de-4568-ac1a-5963f57c6eaa tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.149863 Feb 07 04:23:36.566623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 483/982] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:36 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:37.411247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:37.411247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:37.418162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:37.418765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:37.420519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:37.421221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:37.561004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:37.568568 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-397af7ab-caf8-4cf7-a6bd-fb778443e8a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.162729 Feb 07 04:23:37.569131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 500/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:37 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:37.582223 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:37.582834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:37.589137 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:37.589592 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:37.590369 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:37.591345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:37.729243 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:37.737149 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2c701353-17ca-45c3-b8f5-10d12ec137ca tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.158525 Feb 07 04:23:37.737720 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 484/984] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:37 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:38.585391 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:38.585916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:38.592172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:38.592620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:38.593389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:38.593824 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:38.723403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:38.730639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-20ccdba2-2e3d-47bb-a673-cce43aecba94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.148918 Feb 07 04:23:38.731231 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 501/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:38 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:38.753825 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:38.754442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:38.760702 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:38.761160 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:38.761940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:38.762379 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:38.892712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:38.900312 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-31ed29fd-1daa-4677-a9aa-6c95e180176e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.149772 Feb 07 04:23:38.900887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 485/986] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:38 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:39.747784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:39.748426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:39.754681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:39.755134 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:39.755907 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:39.756372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:39.893913 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:39.901608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f8a74b72-4df2-4bb8-b841-d7d01d6e8bf9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.157436 Feb 07 04:23:39.902154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 502/987] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:39 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:39.916929 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:39.917571 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:39.924384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:39.924837 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:39.925615 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:39.926051 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:40.057929 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:40.065144 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-89924cbb-b58c-4c7b-82df-d36533502907 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.151791 Feb 07 04:23:40.065690 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 486/988] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:39 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:40.918444 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:40.919647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:40.925858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:40.926303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:40.927075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:40.927509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:41.058899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:41.068963 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-57408fb2-6842-4b58-a7cd-8303748fae34 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154174 Feb 07 04:23:41.069524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 503/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:40 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:41.081452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:41.082067 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:41.088247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:41.088693 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:41.089464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:41.089893 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:41.218037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:41.225200 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c9f4502e-baf5-4d30-b343-d342b85de347 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.147336 Feb 07 04:23:41.225761 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 487/990] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:41 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:42.085881 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:42.086422 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:42.092699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:42.093148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:42.093916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:42.094364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:42.222384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:42.229448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-baec8d90-022c-4095-90cf-7e271865a04f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.147294 Feb 07 04:23:42.230001 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 504/991] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:42 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:42.241665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:42.242274 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:42.248916 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:42.249359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:42.250157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:42.250585 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:42.384526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:42.391624 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3150ca1d-e508-4fa0-a348-dd78d4667b6c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.153596 Feb 07 04:23:42.392211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 488/992] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:42 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:43.246575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:43.247108 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:43.253720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:43.254173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:43.254960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:43.255402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:43.392615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:43.400118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6b9b4e7f-6421-4190-8688-e6717d13d9dd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.157064 Feb 07 04:23:43.400679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 505/993] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:43 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:43.408900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:43.409515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:43.415709 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:43.416199 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:43.416978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:43.417411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:43.545915 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:43.553094 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0171b00c-2c13-40fc-b8a3-2671d77b590d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.147824 Feb 07 04:23:43.553661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 489/994] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:43 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:44.417290 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:44.417908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:44.424729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:44.425183 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:44.425965 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:44.426411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:44.557793 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:44.565742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9cfabe2f-f8ef-4f37-9649-aff87b8a7d07 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152147 Feb 07 04:23:44.566298 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 506/995] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:44 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:44.569835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:44.570445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:44.577235 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:44.577684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:44.578464 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:44.578906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:44.708259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:44.718194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f60f08dc-45f8-4e1a-b948-7ea87ebf8de5 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.152010 Feb 07 04:23:44.719218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 490/996] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:44 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:45.181113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-585cfbd5-1934-4fdf-afe1-f1c19b77e2c9 req-eeef2e5a-18aa-43f5-ad75-4dd5dc1b369c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b7e502-8196-48b1-a7ad-77ec28c6dbad", "name": "network-vif-plugged", "status": "completed", "tag": "23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:23:45.182803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:23:45.182803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:23:45.189928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-585cfbd5-1934-4fdf-afe1-f1c19b77e2c9 req-eeef2e5a-18aa-43f5-ad75-4dd5dc1b369c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:45.190090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-585cfbd5-1934-4fdf-afe1-f1c19b77e2c9 req-eeef2e5a-18aa-43f5-ad75-4dd5dc1b369c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:45.201063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-585cfbd5-1934-4fdf-afe1-f1c19b77e2c9 req-eeef2e5a-18aa-43f5-ad75-4dd5dc1b369c service nova] Creating event network-vif-plugged:23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca for instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad on hv-cinder-79963 Feb 07 04:23:45.210401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-585cfbd5-1934-4fdf-afe1-f1c19b77e2c9 req-eeef2e5a-18aa-43f5-ad75-4dd5dc1b369c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 Feb 07 04:23:45.210995 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 507/997] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:23:45.582719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:45.583334 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:45.589738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:45.590197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:45.591565 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:45.592003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:45.723669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:45.731387 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f62ed956-5630-403e-a9af-beb4e16cc388 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151985 Feb 07 04:23:45.732187 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 491/998] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:45 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:45.738865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:45.738865 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:45.749681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:45.750137 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:45.756178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:45.756639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:45.891494 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:45.898851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-403fb364-a20b-4153-a9b1-f6509d40b43d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.166101 Feb 07 04:23:45.899607 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 508/999] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:45 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:46.748151 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:46.748673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:46.754899 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:46.755352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:46.756164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:46.756604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:46.889367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:46.896927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-39565a8b-060b-4852-8248-09ac793e4497 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152493 Feb 07 04:23:46.906454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 492/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:46 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:46.916969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:46.917661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:46.924683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:46.925205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:46.926059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:46.926558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:47.062121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:47.069491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e8e8025c-fee9-40e6-887b-c2c83a222ad9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1266 microversion: 2.1 time: 0.156216 Feb 07 04:23:47.070048 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 509/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:46 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:47.914120 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:47.914733 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:47.921004 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:47.921454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:47.922228 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:47.922661 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:48.051352 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:48.058563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9e59d3b8-fcc1-4c63-9f47-8a7d86976bbb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.148395 Feb 07 04:23:48.059160 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 493/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:47 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:48.089989 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:48.091142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:48.097388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:48.097839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:48.098618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:48.099058 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:48.229433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:48.236827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9bd3c05e-3473-49b1-a1a9-5da0a070215f tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1453 microversion: 2.1 time: 0.150546 Feb 07 04:23:48.237387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 510/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:48.253206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:48.253812 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:48.259443 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:48.259889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:48.260699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:48.261130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:48.390242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af228b237eb4e93baf30ade75bdca98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ebc5dbe4c54633a6605d9a54949953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:48.397516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-232e7d6c-712f-4608-a71f-dcf6a44a8223 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 200 len: 1453 microversion: 2.1 time: 0.147958 Feb 07 04:23:48.398078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 494/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:49.075250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:49.076075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:49.082854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:49.083387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:49.084301 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:49.084785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:49.225813 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:49.237096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f5b51d28-dcb2-4ae6-b8de-da0962a59125 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.166147 Feb 07 04:23:49.237976 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 511/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:50.235314 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1612793277"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:23:50.235698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:50.241921 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:50.242374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:50.243153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:50.243588 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:50.253803 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:50.254589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:50.261014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:50.261465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:50.262346 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:50.263307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:50.398277 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:50.405991 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7f239aac-c664-412d-9d7a-ef3efeebe71e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155817 Feb 07 04:23:50.406566 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 512/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:50 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:50.475169 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.network.security_group_api [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Removing security group 254921dc-aefe-4e71-b95d-122a6e128371 from port 8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 Feb 07 04:23:50.488166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-5c9d0132-c3ce-4fde-90cf-251c76289356 req-218838ae-5f12-452f-991f-7567724930d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b7e502-8196-48b1-a7ad-77ec28c6dbad", "tag": "23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:23:50.489912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:23:50.489912 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:23:50.497566 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-5c9d0132-c3ce-4fde-90cf-251c76289356 req-218838ae-5f12-452f-991f-7567724930d3 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:50.498013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-5c9d0132-c3ce-4fde-90cf-251c76289356 req-218838ae-5f12-452f-991f-7567724930d3 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:50.508718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-5c9d0132-c3ce-4fde-90cf-251c76289356 req-218838ae-5f12-452f-991f-7567724930d3 service nova] Creating event network-changed:23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca for instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad on hv-cinder-79963 Feb 07 04:23:50.514777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-5c9d0132-c3ce-4fde-90cf-251c76289356 req-218838ae-5f12-452f-991f-7567724930d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030125 Feb 07 04:23:50.515543 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 513/1007] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:23:50.979601 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-182298b3-6e31-44a1-96a7-59c0c9294272 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/action" status: 202 len: 0 microversion: 2.1 time: 0.748180 Feb 07 04:23:50.982298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 495/1008] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Feb 7 04:23:50 2022] POST /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:23:51.423885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:51.424715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:51.430986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:51.431729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:51.432626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:51.433239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:51.664571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:51.672167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-82803f2d-6340-4fb3-9db9-4545afc8c28d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.252969 Feb 07 04:23:51.682047 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 514/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:51 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:52.388003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:52.388532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:52.389433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-76954d38-e756-4681-8bce-e4ea28329778 req-d20cd14d-5d37-4ae3-b878-e83c8f857eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:23:52.391047 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:23:52.391047 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:23:52.394580 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:52.395109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:52.395992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:52.396697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:52.398311 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-76954d38-e756-4681-8bce-e4ea28329778 req-d20cd14d-5d37-4ae3-b878-e83c8f857eb1 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:52.398749 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-76954d38-e756-4681-8bce-e4ea28329778 req-d20cd14d-5d37-4ae3-b878-e83c8f857eb1 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:52.410444 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-76954d38-e756-4681-8bce-e4ea28329778 req-d20cd14d-5d37-4ae3-b878-e83c8f857eb1 service nova] Creating event network-changed:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:23:52.415297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-76954d38-e756-4681-8bce-e4ea28329778 req-d20cd14d-5d37-4ae3-b878-e83c8f857eb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030527 Feb 07 04:23:52.415925 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 515/1010] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:23:52.531540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-1e261fe7-dec8-448e-b124-7c2cba16a912 req-2202dd57-664d-4548-ba4b-79f2bb3719a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:23:52.533091 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:23:52.533091 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:23:52.540812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-1e261fe7-dec8-448e-b124-7c2cba16a912 req-2202dd57-664d-4548-ba4b-79f2bb3719a9 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:52.541379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-1e261fe7-dec8-448e-b124-7c2cba16a912 req-2202dd57-664d-4548-ba4b-79f2bb3719a9 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:52.553107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-1e261fe7-dec8-448e-b124-7c2cba16a912 req-2202dd57-664d-4548-ba4b-79f2bb3719a9 service nova] Creating event network-changed:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:23:52.558148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-1e261fe7-dec8-448e-b124-7c2cba16a912 req-2202dd57-664d-4548-ba4b-79f2bb3719a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 Feb 07 04:23:52.559251 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 516/1011] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:23:52.689570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:52.690627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:52.696812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:52.697466 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:52.698257 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:52.698695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:52.851010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:52.858852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c5112812-5b28-4e1c-badf-cc14591e89a3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.173201 Feb 07 04:23:52.860181 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 517/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:52 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:23:53.877100 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:53.877731 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:53.883942 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:53.884421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:53.885193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:53.885621 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:54.016706 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:54.023947 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-96c28573-f50f-449b-884c-fce4d24bccc5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150541 Feb 07 04:23:54.024545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 518/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:53 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:55.041348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:55.041945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:55.048798 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:55.049227 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:55.050009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:55.050475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:55.185279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:55.192567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-20af94b1-12e9-4e2b-adb8-ffffe1403ee8 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154855 Feb 07 04:23:55.193129 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 519/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:55 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:56.209270 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:56.209957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:56.216150 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:56.216605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:56.217386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:56.217828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:56.348762 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:56.355959 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bbf8b513-5bd5-4c08-a198-300d03195a95 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150472 Feb 07 04:23:56.356549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 520/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:56 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:57.372704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:57.374913 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:57.379719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:57.380193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:57.381002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:57.381438 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:57.512871 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:57.520107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4e5932e5-1947-4464-8e41-f015df1860ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151190 Feb 07 04:23:57.520671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 521/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:57 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:58.537432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:58.538111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:58.544323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:58.544776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:58.545579 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:58.546000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:58.682002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:58.689867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4e2178ca-de1a-40c8-94bc-21a7eacb48c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.156110 Feb 07 04:23:58.690441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 522/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:58 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:23:59.706727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:23:59.707406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:23:59.713642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:59.714088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:59.714858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:23:59.715327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:23:59.850253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:23:59.857979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9df02a3f-07e7-4a8f-8762-24ed4ad5813e tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155049 Feb 07 04:23:59.858535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 523/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:23:59 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:00.873746 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:00.874434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:00.880705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:00.881164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:00.881956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:00.882400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:01.022236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:01.030244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2a410680-cbf0-4d40-b198-993a9a4faf19 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.160193 Feb 07 04:24:01.030815 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 524/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:00 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:02.046927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:02.047528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:02.053755 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:02.054211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:02.054993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:02.055433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:02.187479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:02.194764 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-51eab09a-161c-4caf-aeee-8515d3532407 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151559 Feb 07 04:24:02.195320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 525/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:02 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:03.212606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:03.213239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:03.219967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:03.220456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:03.221239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:03.221676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:03.356678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:03.363972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-33dbbdcb-017c-4c77-93d5-1acdf1d51b65 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155271 Feb 07 04:24:03.364560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 526/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:03 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:04.381390 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:04.382066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:04.388286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:04.388739 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:04.389524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:04.389960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:04.523430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:04.531829 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-710d96f4-4382-44fb-bac3-8f96e3e114cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154082 Feb 07 04:24:04.532431 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 527/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:04 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:05.548534 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:05.549166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:05.555245 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:05.555701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:05.556506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:05.556938 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:05.688428 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:05.695622 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9336515f-d5c2-4d55-b2bd-273e628845b7 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150867 Feb 07 04:24:05.696201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 528/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:05 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:06.712140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:06.712849 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:06.719014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:06.719460 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:06.720268 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:06.720704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:06.854621 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:06.862084 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-995e8840-0a0c-4424-963f-1c84f1f8ef17 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153638 Feb 07 04:24:06.862642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 529/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:06 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:07.878617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:07.879253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:07.885473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:07.885924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:07.886695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:07.887195 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:08.019214 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:08.026714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-07a298b3-cdb3-4314-8e4b-eb69e4439eb2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151899 Feb 07 04:24:08.027267 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 530/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:07 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:09.043254 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:09.044450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:09.050752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:09.051204 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:09.051982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:09.052443 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:09.187113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:09.194348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-cb188f4b-5ce5-450d-9cec-bdd732ce7ae1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154847 Feb 07 04:24:09.194906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 531/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:09 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:10.210992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:10.211610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:10.218067 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:10.218513 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:10.219287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:10.219716 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:10.351415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:10.359185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-08be2b4f-e165-4d44-b02c-e4434cd9770d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151877 Feb 07 04:24:10.359737 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 532/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:10 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:11.376805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:11.377461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:11.383660 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:11.384138 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:11.384921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:11.385358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:11.515404 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:11.522685 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d2160119-739f-4949-b972-3c425c6e548b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.149619 Feb 07 04:24:11.523240 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 533/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:11 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:12.539558 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:12.540249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:12.546928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:12.547403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:12.548224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:12.548663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:12.681973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:12.689320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-dfc5613c-9438-4507-9618-ecc52b11dcb1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153482 Feb 07 04:24:12.689880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 534/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:12 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:13.706011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:13.706688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:13.712863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:13.713312 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:13.714083 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:13.714518 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:13.845988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:13.853280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a7e34db6-9446-40df-bd3e-76df9b1d8463 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151007 Feb 07 04:24:13.853829 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 535/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:13 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:14.870029 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:14.870705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:14.877518 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:14.877973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:14.878748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:14.879187 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:15.015656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:15.022951 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6c63685e-54ac-4b9e-8239-b101a5d77d99 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.156630 Feb 07 04:24:15.023519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 536/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:14 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:16.040448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:16.041105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:16.047325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:16.047780 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:16.048586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:16.049032 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:16.181627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:16.188887 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-23b06277-e855-4d47-bed3-17017bcd8647 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152122 Feb 07 04:24:16.189449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 537/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:16 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:17.205054 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:17.205666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:17.211937 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:17.212418 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:17.213204 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:17.213637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:17.345565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:17.352834 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-276b730e-969e-4ab7-8ffc-e48abbe17cd9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151577 Feb 07 04:24:17.353415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 538/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:17 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:18.369990 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:18.370663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:18.378315 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:18.378765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:18.379672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:18.380271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:18.514407 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:18.521699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-843e5418-958e-4022-b732-d3ab3805a010 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155433 Feb 07 04:24:18.522266 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 539/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:18 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:19.538572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:19.539246 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:19.546025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:19.546477 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:19.547288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:19.547725 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:19.688927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:19.696169 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-933a4702-327b-4637-b701-549b874159bd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.161237 Feb 07 04:24:19.696734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 540/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:19 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:20.712986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:20.713645 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:20.720032 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:20.720507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:20.721283 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:20.721712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:20.862133 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:20.869598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e9d1e1e0-3266-43a6-a786-ad5e708eab82 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.160257 Feb 07 04:24:20.870175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 541/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:20 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:21.886399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:21.887004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:21.893954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:21.894411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:21.895197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:21.895637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:22.027165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:22.034587 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-dca5f44e-eab9-4681-b09b-f741a240b21a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151985 Feb 07 04:24:22.035154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 542/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:21 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:23.051053 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:23.051646 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:23.057876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:23.058320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:23.059089 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:23.059520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:23.195962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:23.203571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c0029815-0a65-47b7-86fe-40b119476996 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.156170 Feb 07 04:24:23.204099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 543/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:23 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:24.220410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:24.221057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:24.227267 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:24.227720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:24.228529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:24.228969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:24.362500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:24.369765 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-620579fc-c0ff-4ede-9dd0-3627667a5ba3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153062 Feb 07 04:24:24.370324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 544/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:24 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:25.386304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:25.386952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:25.393671 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:25.394119 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:25.394893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:25.395327 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:25.524985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:25.532236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0af07f11-d0e5-4fd0-98b9-177811fe47ec tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.149588 Feb 07 04:24:25.532792 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 545/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:25 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:26.548944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:26.549614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:26.555559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:26.556018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:26.556834 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:26.557276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:26.692738 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:26.700033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a9272720-016a-40f5-be49-4b8d5eb259b1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154926 Feb 07 04:24:26.700678 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 546/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:26 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:27.716741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:27.717417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:27.723471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:27.723920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:27.724732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:27.725170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:27.858985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:27.866495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e550f9d1-2a34-4f64-90ac-73e8d03d2cac tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153446 Feb 07 04:24:27.867057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 547/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:27 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:28.883987 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:28.884742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:28.891540 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:28.891990 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:28.892827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:28.893259 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:29.027555 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:29.035818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f1059e5a-8bc5-4c58-811f-87df9ab65911 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.155462 Feb 07 04:24:29.036405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 548/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:28 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:30.052571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:30.053185 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:30.059419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:30.059866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:30.060680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:30.061116 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:30.191497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:30.198886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-57cfbd7c-9d25-4c20-a9de-c5a3fe44e716 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.149949 Feb 07 04:24:30.199451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 549/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:30 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:31.216406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:31.217070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:31.223901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:31.224392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:31.225183 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:31.225624 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:31.372341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:31.381227 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-33205c62-4360-4909-9f69-1fc2df7731c2 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.168571 Feb 07 04:24:31.382094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 550/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:31 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:32.398482 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:32.399152 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:32.406045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:32.406487 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:32.407259 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:32.407692 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:32.541392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:32.549403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e9041206-3e4f-49ec-8384-cc67966a1652 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154578 Feb 07 04:24:32.549967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 551/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:32 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:24:33.566665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:33.567334 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:33.573560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:33.574010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:33.574785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:33.575223 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:33.709899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:33.717354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f8ee679f-5eea-467f-a9a0-0e787fa441a9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154997 Feb 07 04:24:33.717915 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 552/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:33 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:34.694408 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:24:34.694999 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:24:34.734956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:34.735564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:34.741812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:34.742265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:34.743039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:34.743479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:34.877359 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:34.884569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-09872aee-6cf9-4b77-b595-51eb79ec09cf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153862 Feb 07 04:24:34.885127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 553/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:34 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:35.900687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:35.901290 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:35.908154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:35.908605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:35.909387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:35.909825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:36.039654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:36.047774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-18d0307e-9ac7-4a06-9457-1f8ffb2a5f9f tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150424 Feb 07 04:24:36.048380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 554/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:35 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:37.065093 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:37.065711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:37.071931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:37.072419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:37.073197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:37.073638 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:37.206325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:37.213576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d6e05481-aa27-4900-89fc-33f64a4c461a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152728 Feb 07 04:24:37.214137 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 555/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:37 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:38.229386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:38.230025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:38.236162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:38.236609 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:38.237378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:38.237808 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:38.369911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:38.377734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1e2e27c2-47d9-44d2-9401-b1b30c4371ca tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152095 Feb 07 04:24:38.378286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 556/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:38 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:39.395982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:39.396656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:39.403451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:39.403905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:39.404713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:39.405145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:39.548174 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:39.556205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-64d89a09-1bf1-4507-b55d-3751ac9adb57 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.164714 Feb 07 04:24:39.556828 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 557/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:39 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:40.573016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:40.573683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:40.580436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:40.580889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:40.581661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:40.582098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:40.714265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:40.721512 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8e2dc21c-d94b-408a-9148-bd69fd527d12 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152243 Feb 07 04:24:40.722072 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 558/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:40 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:41.738652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:41.739309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:41.745492 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:41.745945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:41.746733 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:41.747172 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:41.878362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:41.885682 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-467cfa68-89df-4401-8007-373743dd080b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.151240 Feb 07 04:24:41.886240 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 559/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:42.902784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:42.903442 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:42.909614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:42.910064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:42.910835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:42.911272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:43.045563 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:43.053412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b69706e4-5a94-4651-82c8-2d587ba546d9 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154606 Feb 07 04:24:43.053983 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 560/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:42 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:44.069983 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:44.070612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:44.076841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:44.077297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:44.078081 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:44.078522 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:44.207251 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:44.214480 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3dac83d0-e231-4131-a06d-dba1db58c8ed tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.148171 Feb 07 04:24:44.215038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 561/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:44 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:45.230973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:45.231560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:45.238007 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:45.238476 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:45.239232 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:45.239666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:45.374891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:45.382093 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0c0bd3f4-8afc-4261-98dd-e5fd1a9d9882 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.154884 Feb 07 04:24:45.383165 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 562/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:45 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:46.400426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:46.401073 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:46.407170 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:46.408157 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:46.408928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:46.409362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:46.545426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:46.553687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-eb227a85-293c-4cf5-a02f-8ce8cb7fe2f3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.157233 Feb 07 04:24:46.554242 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 563/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:46 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:47.570074 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:47.570722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:47.576545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:47.576994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:47.577766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:47.578226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:47.763635 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:47.770930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8adccd79-9439-417b-a414-6eab5a441306 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.204526 Feb 07 04:24:47.771480 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 564/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:47 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:48.787827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:48.788509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:48.794868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:48.795329 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:48.796158 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:48.796598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:48.930515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:48.937724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c2a61b9d-759f-479f-9ecb-45e1dc533b9d tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.153560 Feb 07 04:24:48.938286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 565/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:48 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:49.954819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:49.955435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:49.961748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:49.962201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:49.962977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:49.963416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:50.093998 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:50.101329 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-790effe7-bb7c-4f1a-805d-0d4f964933bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150758 Feb 07 04:24:50.101883 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 566/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:50.115708 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:24:50.116213 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:24:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:24:51.118351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:51.118970 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:51.125307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:51.125767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:51.126553 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:51.126998 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:51.259857 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:51.267933 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0a83090a-71fa-4cd9-8200-3c1479fb2ff1 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.152873 Feb 07 04:24:51.268538 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 567/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:51 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:52.284981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:52.285639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:52.291814 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:52.292297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:52.293110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:52.293547 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:52.424353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:24:52.431603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-22314a15-f167-4ffb-9249-a5b9b3b3dc64 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.150456 Feb 07 04:24:52.432186 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 568/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:24:52 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:24:52.446205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:24:52.446690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:24:52.452107 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:52.452554 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:52.453322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:24:52.453753 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:24:58.487055 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:24:58.487695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:25:19.580677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:25:19.581800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:25:39.814246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:25:39.875625 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:26:29.028378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:26:29.028988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:26:45.500877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:26:45.501501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:27:39.975757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26c3b86f-5272-408e-9ab4-099f5baf184d) Feb 07 04:27:39.976596 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26c3b86f-5272-408e-9ab4-099f5baf184d) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:27:39.978226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-32a333d0-9c8d-432b-9214-7ef73992269f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 167.535319 Feb 07 04:27:39.979495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 569/1064] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:24:52 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 269 bytes in 167537 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 07 04:27:39.992191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-645f004f-791a-4963-836b-937f4536d1ad tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 202 len: 0 microversion: 2.1 time: 227.609250 Feb 07 04:27:39.992978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 496/1065] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:23:52 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 227611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:27:39.999126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:27:39.999695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:27:40.006153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.006618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.007710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.008261 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.109858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:27:40.110742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:27:40.118406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.119077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.120091 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.120724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.277711 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:27:40.290832 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-63819d3c-dcf6-4918-a2e6-48aa1714d473 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.309589 Feb 07 04:27:40.291730 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 570/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:27:39 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:27:40.296929 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:27:40.297823 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:27:40.304680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.305299 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.306324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.306764 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.449439 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:27:40.457351 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-96d5facb-e6ba-4c91-a414-42f8df6244f4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.164320 Feb 07 04:27:40.457909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 571/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:27:40 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:27:40.462304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:27:40.462855 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:27:40.468078 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.468599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:40.469389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:27:40.469827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:27:54.702244 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:27:54.702873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:28:10.123668 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:28:10.124574 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:28:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:28:18.494376 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:28:18.494942 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:28:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:29:40.358594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:29:40.402860 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:29:49.037402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:29:49.037980 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:30:05.508357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:30:05.509380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:30:19.591527 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:30:19.592320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:30:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:31:14.710107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:31:14.710850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:31:30.131485 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:31:30.131996 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:31:38.502058 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:31:38.502590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:31:40.583210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b625cb7b-000c-462b-9649-68c6a6f4d511) Feb 07 04:31:40.583918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b625cb7b-000c-462b-9649-68c6a6f4d511) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:31:40.585651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 240.590940 Feb 07 04:31:40.585651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:31:40.585651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:31:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:31:40.586860 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-21c92706-817b-4700-bc03-45646fe96f6d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:31:40.586860 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:31:40.586860 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:31:40.587106 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 497/1068] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:27:39 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 240594 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:31:40.592870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:31:40.594135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:31:40.600234 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.602368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.603256 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.603878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.649002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6109ac84-4dc2-4378-a101-6dccbaca1ed8) Feb 07 04:31:40.649647 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6109ac84-4dc2-4378-a101-6dccbaca1ed8) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:31:40.650491 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a999ffee-f846-41df-8566-71cdb4d9e224 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 240.191601 Feb 07 04:31:40.653415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 572/1069] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:27:40 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 269 bytes in 240195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:31:40.660728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:31:40.663097 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:31:40.672239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.673194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.674173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.674838 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.701528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:31:40.754146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:31:40.763470 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f9541744-830b-4bb2-9073-3590cdae2b98 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.175427 Feb 07 04:31:40.764300 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 498/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:31:40 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:31:40.780486 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7a6b92bb-b5c4-4f46-a0f7-b08fedecb68d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.125317 Feb 07 04:31:40.781183 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 573/1071] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:31:40 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:31:40.787879 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:31:40.788518 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:31:40.794419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.794884 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.795860 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.796234 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.826821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-0cd62d13-af75-4a8a-bda8-5ff3238790fa req-479d40e4-8077-4c4b-94fd-fab4b284c907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b7e502-8196-48b1-a7ad-77ec28c6dbad", "tag": "23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:31:40.828383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:31:40.828383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:31:40.835388 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-0cd62d13-af75-4a8a-bda8-5ff3238790fa req-479d40e4-8077-4c4b-94fd-fab4b284c907 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.835831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-0cd62d13-af75-4a8a-bda8-5ff3238790fa req-479d40e4-8077-4c4b-94fd-fab4b284c907 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.846224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-0cd62d13-af75-4a8a-bda8-5ff3238790fa req-479d40e4-8077-4c4b-94fd-fab4b284c907 service nova] Creating event network-changed:23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca for instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad on hv-cinder-79963 Feb 07 04:31:40.852150 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-0cd62d13-af75-4a8a-bda8-5ff3238790fa req-479d40e4-8077-4c4b-94fd-fab4b284c907 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086816 Feb 07 04:31:40.852787 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 499/1072] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:31:40.857462 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:31:40.858298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:31:40.864474 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.864926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:40.865699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:40.866171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:41.076017 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:31:41.083287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3286ca16-f334-4172-98d1-135bf0f424bf tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1568 microversion: 2.1 time: 0.229433 Feb 07 04:31:41.083852 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 500/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:31:40 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:31:41.088029 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:31:41.088546 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:31:41.094154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:41.094505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:41.095299 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:41.095739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:41.121034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:31:41.162822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Instance is already in deleting state, ignoring this request Feb 07 04:31:41.163641 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b7b49725-1e22-4b2b-b7fc-da7b97f873a7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.078851 Feb 07 04:31:41.164743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 501/1074] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:31:41 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:31:41.169154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:31:41.169637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:31:41.175032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:41.175483 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:31:41.176299 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:31:41.176742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:09.046760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:33:09.047339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:33:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:33:40.904660 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:33:40.928542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:33:41.034412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2202dc01-934d-4232-9807-1e791cdc10c2) Feb 07 04:33:41.035023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2202dc01-934d-4232-9807-1e791cdc10c2) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:33:41.035892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 120.253316 Feb 07 04:33:41.036432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:33:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:33:41.036432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:33:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:33:41.037226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-d05ba967-09ca-4fda-a9e7-24976baa1c4e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:33:41.037226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:33:41.037226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:33:41.037509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 574/1075] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:31:40 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 120256 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:33:41.065895 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-305d4e58-b3f3-4a7d-ac88-eb197e6c121a) Feb 07 04:33:41.066595 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-305d4e58-b3f3-4a7d-ac88-eb197e6c121a) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:33:41.067516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6cb611f8-6d5f-47bd-94c3-bbab18790f62 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 119.901866 Feb 07 04:33:41.068172 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 502/1076] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:31:41 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 269 bytes in 119903 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:33:41.073225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:33:41.073786 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:33:41.080127 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.080649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.081496 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.082018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.105930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:33:41.153046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Instance is already in deleting state, ignoring this request Feb 07 04:33:41.154006 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-87daca89-490c-4df8-b14f-f525e6f8e02c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.084822 Feb 07 04:33:41.154587 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 503/1077] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:33:41 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:33:41.226173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:33:41.226791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:33:41.232521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.232977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.233754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.234192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.295765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:33:41.296307 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:33:41.302222 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.302670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.303452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.303885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.378743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:33:41.384340 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:33:41.387962 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-713f911d-208b-4f7f-9e82-cd45802354fb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1562 microversion: 2.1 time: 0.349602 Feb 07 04:33:41.389198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 575/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:33:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 1562 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:33:41.486113 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:33:41.486617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:33:41.492393 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.492850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.493639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.494083 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.518805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:33:41.590353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d4bd7604-40bf-4300-9265-8dbd5cfe8f04 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 204 len: 0 microversion: 2.20 time: 0.199844 Feb 07 04:33:41.590935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 576/1079] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:33:41 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 07 04:33:41.596189 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:33:41.596763 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:33:41.602818 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.603270 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:33:41.604063 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:33:41.604498 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:34:34.717894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:34:34.718479 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:34:50.140246 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:34:50.140993 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:34:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:34:58.509704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:34:58.510220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:35:41.092772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 202 len: 0 microversion: 2.1 time: 119.936334 Feb 07 04:35:41.093729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:35:41.093843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:35:41 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:35:41.094865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-75d93f48-c24d-4f30-b3dc-ee759e60721a tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:35:41.094865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:35:41.094865 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:35:41.095132 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 504/1080] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:33:41 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 119940 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:35:41.102711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:35:41.103510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:35:41.111752 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.112643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.113620 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.114217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.133750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:35:41.257145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:35:41.264487 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1562 microversion: 2.1 time: 0.167979 Feb 07 04:35:41.265035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:35:41.265035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:35:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:35:41.265908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-d89bad81-328d-4ff1-a29e-72a7a39d4d80 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:35:41.265908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:35:41.265908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:35:41.266164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 505/1081] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:35:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:35:41.270182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:35:41.270670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:35:41.275955 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.276434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.277204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.277638 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.300947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:35:41.345878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Instance is already in deleting state, ignoring this request Feb 07 04:35:41.346691 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.079786 Feb 07 04:35:41.347208 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:35:41.347208 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:35:41 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:35:41.347775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-80ea868a-5f77-4454-94d9-e7709e3a96a2 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:35:41.347775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:35:41.347775 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:35:41.348116 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 506/1082] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:35:41 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:35:41.352833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:35:41.353318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:35:41.358522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.358973 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.359729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.360197 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.440026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4823afc5-4f3a-4f45-a854-188762373d49) Feb 07 04:35:41.440695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4823afc5-4f3a-4f45-a854-188762373d49) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:35:41.441597 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 119.849399 Feb 07 04:35:41.442098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:35:41.442098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:35:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:35:41.442777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-a4017827-70f8-494f-858c-1437390879a4 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:35:41.442777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:35:41.442777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:35:41.443033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 577/1083] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:33:41 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 119851 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:35:41.448374 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:35:41.448862 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:35:41.454568 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.455010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.455787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.456306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.469002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:35:41.469580 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:35:41.470386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.026622 Feb 07 04:35:41.470896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:35:41.470896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:35:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:35:41.471449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-600ce46e-1129-4f22-9462-a55f3ad705f6 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:35:41.471449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:35:41.471449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:35:41.471709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 578/1084] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:35:41 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:35:41.476408 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:35:41.476832 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:35:41.484322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.485182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:35:41.485439 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:35:41.486258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:35:41.486693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:36:29.054712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:36:29.055305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:36:45.519876 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:36:45.520599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:37:41.279827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98a49fb0-41eb-4639-a608-6ca57ebb1faa) Feb 07 04:37:41.280476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98a49fb0-41eb-4639-a608-6ca57ebb1faa) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:37:41.281320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 119.932520 Feb 07 04:37:41.282285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:37:41.282285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:37:41.282892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-bda44a00-9b0c-4072-a1e3-6eedd1660e53 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:37:41.282892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:37:41.282892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:37:41.283154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 507/1085] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:35:41 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 119935 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:37:41.288141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:37:41.289071 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:37:41.295154 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.295607 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.296486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.296883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.381716 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:37:41.440288 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:37:41.448195 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1562 microversion: 2.1 time: 0.164206 Feb 07 04:37:41.448704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:37:41.448704 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:37:41.449286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-9cfc5c8f-093d-4e23-b667-3ed47ae92b1c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:37:41.449286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:37:41.449286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:37:41.449539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 508/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:37:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:37:41.453656 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:37:41.454148 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:37:41.460027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.460506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.461281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.461717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.484442 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:37:41.530459 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Instance is already in deleting state, ignoring this request Feb 07 04:37:41.531272 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.080986 Feb 07 04:37:41.531790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:37:41.531790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:41 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:37:41.532384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-5546b342-3970-47ac-af9a-84c4ad70b2d9 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:37:41.532384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:37:41.532384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:37:41.532652 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 509/1087] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:37:41 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:37:41.536863 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:37:41.537389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:37:41.539897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7fc9116-b724-4f5b-b683-a522883ad525) Feb 07 04:37:41.540525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f7fc9116-b724-4f5b-b683-a522883ad525) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:37:41.541364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 120.068950 Feb 07 04:37:41.541863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:37:41.541863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:37:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:37:41.542561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-b9ce7f08-0aa7-456c-9b3b-f004dfa78e5f tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:37:41.542561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:37:41.542561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:37:41.542561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 579/1088] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:35:41 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 120070 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:37:41.547463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:37:41.547961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:37:41.550644 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.551105 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.552270 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.554019 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.555162 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.555617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.556436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.556883 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.570821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:37:41.571381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:37:41.572227 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.028795 Feb 07 04:37:41.572727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:37:41.572727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:37:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:37:41.573291 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-24bd1921-401b-4bfe-9153-dc4a6b5b012f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:37:41.573291 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:37:41.573291 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:37:41.573718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 580/1089] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:37:41 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:37:41.629193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-8202f27c-4803-49d2-8842-cd09eea32025 req-f5019e95-8d70-4670-9ad9-92ab9a0dc410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b7e502-8196-48b1-a7ad-77ec28c6dbad", "name": "network-vif-deleted", "tag": "23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:37:41.630766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:37:41.630766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:37:41.641536 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-8202f27c-4803-49d2-8842-cd09eea32025 req-f5019e95-8d70-4670-9ad9-92ab9a0dc410 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.641981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-8202f27c-4803-49d2-8842-cd09eea32025 req-f5019e95-8d70-4670-9ad9-92ab9a0dc410 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.654774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-8202f27c-4803-49d2-8842-cd09eea32025 req-f5019e95-8d70-4670-9ad9-92ab9a0dc410 service nova] Creating event network-vif-deleted:23ce1d0e-d0d7-4f7c-8e8e-777898a5a2ca for instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad on hv-cinder-79963 Feb 07 04:37:41.660709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-8202f27c-4803-49d2-8842-cd09eea32025 req-f5019e95-8d70-4670-9ad9-92ab9a0dc410 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085891 Feb 07 04:37:41.661241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Feb 07 04:37:41.661241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:37:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.13) Feb 07 04:37:41.661895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [req-8202f27c-4803-49d2-8842-cd09eea32025 req-f5019e95-8d70-4670-9ad9-92ab9a0dc410 service nova] Unhandled error: OSError: write error Feb 07 04:37:41.661895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:37:41.661895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:37:41.662166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 581/1090] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:37:41.669692 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:37:41.670560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:37:41.679775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.680496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:41.681677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:37:41.682355 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:37:54.727255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:37:54.727834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:38:10.148423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:38:10.149165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:38:18.517670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:38:18.518182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:38:39.605042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:38:39.605637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:39:41.486726 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:39:41.583388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:39:41.608568 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6c7d84f5-0df5-4353-bdb8-dd85ad977964) Feb 07 04:39:41.609190 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6c7d84f5-0df5-4353-bdb8-dd85ad977964) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:39:41.610030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 120.076647 Feb 07 04:39:41.610539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:39:41.610539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:39:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:39:41.611115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-d68763ab-0430-4ca8-8733-c8b1881f73b2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:39:41.611115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:39:41.611115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:39:41.611391 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 510/1091] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:37:41 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 120078 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:39:41.688980 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:39:41.689599 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:39:41.696036 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:39:41.696531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:39:41.697305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:39:41.697746 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:39:41.831210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:39:41.838435 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1444 microversion: 2.1 time: 0.226296 Feb 07 04:39:41.838971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:39:41.838971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:39:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:39:41.839540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-029873bf-c82f-47bd-9d59-91cb0913e59a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:39:41.839540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:39:41.839540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:39:41.839798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 511/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:39:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:39:41.843781 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:39:41.844312 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:39:41.850039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:39:41.850506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:39:41.851262 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:39:41.851701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:39:41.876427 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:39:41.920216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Instance is already in deleting state, ignoring this request Feb 07 04:39:41.920969 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.080380 Feb 07 04:39:41.921481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:39:41.921481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:39:41 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:39:41.922052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-0f4e5383-d177-4a88-b3d3-e21812bc643c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:39:41.922052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:39:41.922052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:39:41.922321 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 512/1093] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:39:41 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:39:41.927177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:39:41.927654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:39:41.932960 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:39:41.933405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:39:41.934186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:39:41.934621 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:39:49.062648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:39:49.063180 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:39:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:40:05.527675 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:40:05.528316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:41:14.737777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:41:14.738353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:41:30.155868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:41:30.156575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:41:38.525521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:41:38.526225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:41:41.677046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d9d8f36-9273-4773-aafe-47910660b700) Feb 07 04:41:41.677733 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d9d8f36-9273-4773-aafe-47910660b700) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:41:41.679699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 240.015427 Feb 07 04:41:41.679699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:41:41.679699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:41:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:41:41.680307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-4030e733-32d3-44c9-b04a-069da802e9f5 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:41:41.680307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:41:41.680307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:41:41.680307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 582/1094] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:37:41 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 240018 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:41:41.711048 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:41:41.814593 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:41:41.815086 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:41:41.821464 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:41:41.821909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:41:41.822679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:41:41.823114 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:41:41.836184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:41:41.836752 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:41:41.837551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.156096 Feb 07 04:41:41.838024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:41:41.838024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:41:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:41:41.838585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-1f1fbabf-a020-4bfd-9a89-0b395cdc934b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:41:41.838585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:41:41.838585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:41:41.838831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 583/1095] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:41:41 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:41:41.842844 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:41:41.843321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:41:41.849401 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:41:41.849841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:41:41.850600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:41:41.851036 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:41:59.613343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:41:59.614136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:41:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:43:09.070893 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:43:09.071433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:43:25.535325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:43:25.536734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:43:41.946001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e47f3e0-5ff2-45fd-9822-26521e55af2b) Feb 07 04:43:41.946647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7e47f3e0-5ff2-45fd-9822-26521e55af2b) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 240.024439 Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-2b65d466-5405-4e29-b82a-cfe773c6156f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:41.949700 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 513/1096] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:39:41 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 240026 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:41.955180 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:41.955500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:41.963102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:41.963550 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:41.964484 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:41.964818 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:41.980661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:42.041899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f7c72b5-78fe-4c93-8ee5-f4afbb85df7f) Feb 07 04:43:42.042522 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f7c72b5-78fe-4c93-8ee5-f4afbb85df7f) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.043379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 120.203814 Feb 07 04:43:42.043920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:43:42.043920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:43:42.044539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-1eeb7a12-21a7-4e4f-b4de-f3d78860b5a8 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:43:42.044539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.044539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.044817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 584/1097] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:41:41 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 120205 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.049921 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.050424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.056574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.057033 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.057825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.058269 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.085038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:43:42.105247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:43:42.112866 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1444 microversion: 2.1 time: 0.163244 Feb 07 04:43:42.113396 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:43:42.113396 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:43:42.113964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-218d314c-315a-4d5d-a57f-d28e0599c27a tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:43:42.113964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.113964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.114216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 514/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:43:41 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.118579 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.119174 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.126381 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.126827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.127606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.128058 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.164197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.118201 Feb 07 04:43:42.164674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:43:42.164674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:43:42.165343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-e0030f2d-8532-4cb3-950a-61fa66f5ccc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:43:42.165343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.165343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.165608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 585/1099] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.170354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.170992 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.177684 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.178145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.178936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.179378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.193446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:43:42.194036 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.194856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.028364 Feb 07 04:43:42.195342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:43:42.195342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:43:42.195910 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-20dfc1ae-6a43-46fa-bc06-d3e8a886f27d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:43:42.195910 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.195910 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.196248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 586/1100] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.210699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:42.263717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09833699-6362-4b09-b54f-1faff6253ca4) Feb 07 04:43:42.264471 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-09833699-6362-4b09-b54f-1faff6253ca4) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.265434 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 0.150463 Feb 07 04:43:42.265943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:43:42.265943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:43:42.266526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-5c802137-e25e-4529-b5f4-616c5ecbb7c6 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:43:42.266526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.266526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.266774 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 515/1101] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.271242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.271733 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.277466 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.277918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.278701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.279142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.350474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.351924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.359632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.360308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.361422 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.361831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.366801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:42.395632 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198562 Feb 07 04:43:42.396453 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:43:42.396681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:43:42.397474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-28216875-ff9d-4b1d-a01a-9b968c07e4b5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:43:42.397474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.397474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.397927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 587/1102] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:43:42 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.402537 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.403133 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.409843 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.410303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.411081 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.411866 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.430733 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dca70e91-78c3-48ee-ad37-b73745624dba) Feb 07 04:43:42.431382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dca70e91-78c3-48ee-ad37-b73745624dba) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.432301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.164674 Feb 07 04:43:42.433023 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:43:42.433023 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:43:42.433808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-02d870dc-5a12-4a34-8e71-b34faaf57871 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:43:42.433808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.433808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.434078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 516/1103] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.443402 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.443904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.457861 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.458320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.459261 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.459710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.487268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:43:42.511868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 204 len: 0 microversion: 2.1 time: 0.076896 Feb 07 04:43:42.512513 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:43:42.512699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:43:42.513305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-b1bca303-653c-46f9-8ad1-aaae2a728f2d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:43:42.513305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.513305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.513799 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 517/1104] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.518773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.519297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.525332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.525797 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.526589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.527031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.565888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:43:42.574164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1444 microversion: 2.1 time: 0.175203 Feb 07 04:43:42.574687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:43:42.574687 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:43:42.575303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-1f6f3021-0611-411d-b0f5-bef4f85598e3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:43:42.575303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.575303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.575579 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 588/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:43:42 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.579681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.580209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.593605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.594057 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.594981 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.595493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.608710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:42.610011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:43:42.610604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.611451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.035120 Feb 07 04:43:42.612028 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:43:42.612028 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:43:42.612718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-10283d43-5097-4a1b-8cb4-37db9eb66cc8 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:43:42.612718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.612718 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.612969 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 589/1106] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.617378 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.618330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.624077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.624561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.625330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.625764 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.656069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Feb 07 04:43:42.656589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:43:42.656589 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:43:42.657156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-6c61b40d-cc9f-47c3-9210-f5dc9c7932e8 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:43:42.657156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.657156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.657479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 590/1107] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:43:42 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.661651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.662135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.667630 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.668098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.668886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.669504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.671907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d17d8f68-5158-4c70-877f-279a49e208c7) Feb 07 04:43:42.672637 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d17d8f68-5158-4c70-877f-279a49e208c7) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.673679 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 0.159186 Feb 07 04:43:42.674245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:43:42.674245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:43:42.674819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-30e458fa-9324-46ed-a670-71f6204e118d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:43:42.674819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.674819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.675057 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 518/1108] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.680278 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.680900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.686740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.687221 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.688011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.688654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.749266 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:42.801509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a234ee43-e923-4350-9f2c-a7ae6c644a67) Feb 07 04:43:42.802142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a234ee43-e923-4350-9f2c-a7ae6c644a67) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.802997 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.144831 Feb 07 04:43:42.803506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:43:42.803506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:43:42.804117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-dcba4487-db53-4825-b026-65dfcaa8aabb tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:43:42.804117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.804117 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.804396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 591/1109] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.808570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.809069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.814902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.815373 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.816184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.816624 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.830216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:43:42.830805 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.831660 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.026531 Feb 07 04:43:42.832175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:43:42.832175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:43:42.832743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-31d6d21f-4986-4d88-9ba2-d682780c6205 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:43:42.832743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:42.832743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:42.833010 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 592/1110] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.837280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.837973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.844394 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.844873 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.845658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.846128 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.901078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ab482084d4c6c80e9cc84d5d4d237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2167e4b270e74390ab25c6bf679b1f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:43:42.909809 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 200 len: 1444 microversion: 2.1 time: 0.233116 Feb 07 04:43:42.910339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:43:42.910339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:43:42.910932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-e13210b1-2e97-4689-86ba-200d50eec007 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:43:42.910932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.910932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.911172 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 519/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:43:42 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.915668 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.916206 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.923016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.923466 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.924297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.924743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.939101 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:43:42.939706 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:42.940596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.028634 Feb 07 04:43:42.941116 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:43:42.941116 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:43:42.941696 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-a7093eb5-9c53-4832-bf7f-b28996c55d6f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:43:42.941696 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.941696 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.941943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 520/1112] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.946404 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.947488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:42.955251 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.955712 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.956572 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:42.957017 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:42.989584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Feb 07 04:43:42.990113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:43:42.990113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:43:42.990697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-9e6003d8-d322-48e0-b799-beee9720e962 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:43:42.990697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:42.990697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:42.990941 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 521/1113] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:43:42 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:42.995447 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:42.995939 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.002049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.002512 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.003311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.003749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.078735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:43.156142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:43:43.182713 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d4b701a-bd99-407d-a9eb-1997c7ddd927) Feb 07 04:43:43.183320 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d4b701a-bd99-407d-a9eb-1997c7ddd927) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:43.184191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 0.350420 Feb 07 04:43:43.184780 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:43:43.184780 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:43:43.185282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-24d0fbb0-d640-4302-be91-999b9de400e1 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:43:43.185282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:43.185282 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:43.185521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 593/1114] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.189773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:43.190479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.196727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.197168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.198006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.198415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.216431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-908dd883-4623-4716-9fcd-9102ae9e30ad) Feb 07 04:43:43.217042 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-908dd883-4623-4716-9fcd-9102ae9e30ad) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:43.217884 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.226174 Feb 07 04:43:43.219161 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:43:43.219337 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:43:43.219908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-6f445ef5-9807-4786-a12a-25efde966cda tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:43:43.219908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:43.219908 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:43.220627 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 522/1115] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:42 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.227411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:43:43.285032 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-cb9970b0-440a-4111-bbc8-3eea60542383 req-ff991bf6-75e0-4bec-b867-788ed3126c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443b0913-1482-440f-b9e3-1fb5e8012d94", "tag": "17109406-6d8f-40f6-9417-ddb7abe58df8"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:43:43.286758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:43:43.286758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:43:43.294472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-cb9970b0-440a-4111-bbc8-3eea60542383 req-ff991bf6-75e0-4bec-b867-788ed3126c6f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.294922 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-cb9970b0-440a-4111-bbc8-3eea60542383 req-ff991bf6-75e0-4bec-b867-788ed3126c6f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.306765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-cb9970b0-440a-4111-bbc8-3eea60542383 req-ff991bf6-75e0-4bec-b867-788ed3126c6f service nova] Creating event network-changed:17109406-6d8f-40f6-9417-ddb7abe58df8 for instance 443b0913-1482-440f-b9e3-1fb5e8012d94 on hv-cinder-79963 Feb 07 04:43:43.306928 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 0.120184 Feb 07 04:43:43.307423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:43:43.307423 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:43:43.308120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-12c1d524-9c98-43be-b247-274a13b57ae4 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:43:43.308120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:43.308120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:43.308354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 594/1116] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:43:43 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.314309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:43.314902 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.317903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-cb9970b0-440a-4111-bbc8-3eea60542383 req-ff991bf6-75e0-4bec-b867-788ed3126c6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095982 Feb 07 04:43:43.318429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Feb 07 04:43:43.318429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.13) Feb 07 04:43:43.319224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [req-cb9970b0-440a-4111-bbc8-3eea60542383 req-ff991bf6-75e0-4bec-b867-788ed3126c6f service nova] Unhandled error: OSError: write error Feb 07 04:43:43.319224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:43:43.319224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:43:43.319224 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 523/1117] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.320971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.321430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.322215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.322653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.324118 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:43.324701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.331130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.331581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.332397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.332833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.336709 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:43:43.337278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:43.338095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.028739 Feb 07 04:43:43.338577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:43:43.338577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:43:43.339167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-0aa2a01c-3153-4ca9-aa93-fd7392e9e03a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:43:43.339167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:43.339167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:43.339434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 595/1118] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:43:43 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.343660 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:43.344210 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.349756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.350201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.350977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.351409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.364155 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:43:43.364737 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:43:43.365542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.025403 Feb 07 04:43:43.366043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:43:43.366043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:43:43.366606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-d23ef6fa-b3e7-4300-ba2e-f1f9b50719af tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:43:43.366606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:43.366606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:43.366867 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 596/1119] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:43:43 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.371043 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:43.371982 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.377775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.378216 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.378977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.379409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.409493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 Feb 07 04:43:43.409993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:43:43.409993 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:43:43.410565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-c79f22c9-1276-403b-becc-ce19339906fd tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:43:43.410565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:43.410565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:43.410816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 597/1120] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:43:43 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.466051 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-797062fd-9f5d-45a2-92b1-aa68be39e5d5 req-f43952bb-785f-4c6a-92cd-5d859cacb5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65197dd0-1ef5-46a4-bd5c-c4214703105b", "name": "network-vif-deleted", "tag": "e0bc3bcd-e4e6-47cf-93b5-f2461a823929"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:43:43.467594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:43:43.467594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:43:43.474326 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-797062fd-9f5d-45a2-92b1-aa68be39e5d5 req-f43952bb-785f-4c6a-92cd-5d859cacb5f5 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.474767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-797062fd-9f5d-45a2-92b1-aa68be39e5d5 req-f43952bb-785f-4c6a-92cd-5d859cacb5f5 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.485340 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-797062fd-9f5d-45a2-92b1-aa68be39e5d5 req-f43952bb-785f-4c6a-92cd-5d859cacb5f5 service nova] Creating event network-vif-deleted:e0bc3bcd-e4e6-47cf-93b5-f2461a823929 for instance 65197dd0-1ef5-46a4-bd5c-c4214703105b on hv-cinder-79963 Feb 07 04:43:43.490264 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-797062fd-9f5d-45a2-92b1-aa68be39e5d5 req-f43952bb-785f-4c6a-92cd-5d859cacb5f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078485 Feb 07 04:43:43.490785 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Feb 07 04:43:43.490895 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:43:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.13) Feb 07 04:43:43.491503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [req-797062fd-9f5d-45a2-92b1-aa68be39e5d5 req-f43952bb-785f-4c6a-92cd-5d859cacb5f5 service nova] Unhandled error: OSError: write error Feb 07 04:43:43.491503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:43:43.491503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:43:43.491787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 598/1121] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:43:43.496723 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:43:43.497297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:43:43.503791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.504308 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:43:43.505091 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:43:43.505535 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:44:34.746888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:44:34.747623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:44:50.163871 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:44:50.164754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:44:58.533735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:44:58.534297 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:45:42.637514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:45:42.777896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:46:29.078387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:46:29.078973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:46:45.543719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:46:45.544370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:46:59.623374 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:46:59.623972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:47:42.970213 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d9f7bce-192f-4ef3-8b09-cbd05ff4dbce) Feb 07 04:47:42.970842 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d9f7bce-192f-4ef3-8b09-cbd05ff4dbce) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:47:42.971679 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 239.651446 Feb 07 04:47:42.972214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:47:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:47:42.972214 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:47:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:47:42.972813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-362f96d4-84e8-436b-8db6-a35efc99566f tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:47:42.972813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:47:42.972813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:47:42.973102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 524/1122] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:43 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 239653 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:47:42.977803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:47:42.978326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:47:42.984853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:42.985296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:42.986070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:42.986501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.003927 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-126feb5a-fc34-470f-8922-0e0311094dce) Feb 07 04:47:43.004521 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-126feb5a-fc34-470f-8922-0e0311094dce) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:47:43.005584 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 239.512701 Feb 07 04:47:43.006090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:47:43.006090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:47:43.006797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-b38f5843-5b9a-43a9-b634-ad5a4d8c524d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:47:43.006797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:47:43.006797 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:47:43.007250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 599/1123] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:43:43 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 239515 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:47:43.011729 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:47:43.060835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Instance is already in deleting state, ignoring this request Feb 07 04:47:43.061659 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 0.087870 Feb 07 04:47:43.062171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:47:43.062171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:47:43 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:47:43.062750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-5a980312-5b96-4b0b-99a8-97763caf1c41 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:47:43.062750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:47:43.062750 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:47:43.062988 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 525/1124] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:47:42 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:47:43.067286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:47:43.067776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:47:43.073181 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.073649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.074414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.074853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.127013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:47:43.127517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:47:43.134658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.135099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.135889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.136373 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.149776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:47:43.150366 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:47:43.151202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.142779 Feb 07 04:47:43.151686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:47:43.151686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:47:43.152306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-d77c4749-eab8-458f-8f4d-e8473309cef7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:47:43.152306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:47:43.152306 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:47:43.152560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 600/1125] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:47:43 2022] DELETE /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:47:43.244837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:47:43.245335 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:47:43.251604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.252069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.252858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.253300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.266693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:47:43.267263 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:47:43.268096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.114783 Feb 07 04:47:43.268572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:47:43.268572 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:47:43.269135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-25707008-beae-41dc-93b5-110b5b9867db tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:47:43.269135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:47:43.269135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:47:43.269370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 601/1126] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:47:43 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:47:43.273341 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:47:43.274278 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:47:43.279338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.279816 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.280603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.281045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.309359 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039181 Feb 07 04:47:43.309840 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:47:43.309840 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:47:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:47:43.310403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-d3f5f7b0-90d1-4956-9662-8facd5050576 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:47:43.310403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:47:43.310403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:47:43.310662 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 602/1127] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:47:43 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:47:43.315140 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:47:43.315621 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:47:43.320782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.321228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:43.321990 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:47:43.322434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:47:54.755344 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:47:54.756326 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:48:10.172738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:48:10.173423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:48:18.541783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:48:18.542394 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:49:43.234370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:49:43.319799 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:49:49.086330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:49:49.086858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:50:05.552641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:50:05.553350 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:50:19.631805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:50:19.632425 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:51:14.765678 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:51:14.766400 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:51:30.182341 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:51:30.183109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:51:38.550515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:51:38.551092 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:51:43.422250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17b3365c-497c-4025-b3b0-19c28be5a411) Feb 07 04:51:43.422858 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-17b3365c-497c-4025-b3b0-19c28be5a411) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:51:43.423758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 240.359973 Feb 07 04:51:43.424295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:51:43.424295 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:51:43.424873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-af921a03-83b1-4c12-b854-b7d2d49f1cac tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:51:43.424873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:51:43.424873 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:51:43.425240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 526/1128] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:47:43 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 240362 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:51:43.508874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:51:43.510138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:51:43.516375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.516832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.517623 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.518073 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.522938 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-92dfd124-5625-4095-97a0-4306d72f37cf) Feb 07 04:51:43.523677 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-92dfd124-5625-4095-97a0-4306d72f37cf) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:51:43.524645 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 240.212752 Feb 07 04:51:43.525238 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:51:43.525238 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:51:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:51:43.525952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-340ba9e3-7846-4fa9-ac5a-995b7070fada tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:51:43.525952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:51:43.525952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:51:43.525952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 603/1129] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:47:43 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 240215 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:51:43.532464 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:51:43.533286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:51:43.541023 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.541545 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.542742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.543745 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.544396 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:51:43.558120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:51:43.558734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:51:43.559574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.032555 Feb 07 04:51:43.560194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:51:43.560194 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:51:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:51:43.560748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-d9132422-ae94-4a8d-8320-d144bc9256db tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:51:43.560748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:51:43.560748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:51:43.561099 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 604/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:51:43 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:51:43.565222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:51:43.565708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:51:43.571226 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.571672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.572627 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.573173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.590939 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Instance is already in deleting state, ignoring this request Feb 07 04:51:43.591684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 0.165546 Feb 07 04:51:43.592215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:51:43.592215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:51:43.592791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-3ca0428b-0f28-4d7f-b3b8-46d9cfdb7a94 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:51:43.592791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:51:43.592791 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:51:43.593043 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 527/1131] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:51:43 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:51:43.597714 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:51:43.598204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:51:43.603564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.604013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.604822 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.605259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.618543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:51:43.619200 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:51:43.620024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.025719 Feb 07 04:51:43.620518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:51:43.620518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:51:43.621089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-ca0224f8-bc7e-4286-866d-5f8838392843 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:51:43.621089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:51:43.621089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:51:43.621376 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 528/1132] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:51:43 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:51:43.625450 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:51:43.626393 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:51:43.631812 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.632294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.633094 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.633533 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.662034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039910 Feb 07 04:51:43.662522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:51:43.662522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:51:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:51:43.663089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-7691dc7a-7288-42ee-9085-242921b342d7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:51:43.663089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:51:43.663089 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:51:43.663346 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 529/1133] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:51:43 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:51:43.667343 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:51:43.667825 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:51:43.673599 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.674049 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:51:43.674817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:51:43.675268 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:09.094667 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:53:09.095149 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:53:25.560205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:53:25.560845 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:53:39.639345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:53:39.640070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:43.595670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:43.637001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:44.248406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7ee6faa3-4a25-433c-b590-1658e0f7b0c2) Feb 07 04:53:44.249020 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7ee6faa3-4a25-433c-b590-1658e0f7b0c2) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:44.249888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 120.688129 Feb 07 04:53:44.250372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:53:44.250372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:44 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:53:44.251026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-5ef3449b-7f63-42ac-9353-b0e1cead0813 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:53:44.251026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:44.251026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:44.251026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 605/1134] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:51:43 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 120690 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:44.257289 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:44.257792 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:44.263819 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:44.264321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:44.265199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:44.265639 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:44.291316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:44.338417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.compute.api [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Instance is already in deleting state, ignoring this request Feb 07 04:53:44.339168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 0.087003 Feb 07 04:53:44.339681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:44.339681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:44 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:44.340279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-645c6012-856a-4f55-bd61-e87c6dde4ecd tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:44.340279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:44.340279 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:44.340574 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 606/1135] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:44 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:44.344579 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:44.345685 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:44.350945 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:44.351393 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:44.352193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:44.352630 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:44.365618 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:44.366180 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:44.366967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.025696 Feb 07 04:53:44.367415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:44.367415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:44 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:44.367959 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-de69f241-e937-4362-a5f0-10a74391c4f3 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:44.367959 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:44.367959 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:44.368243 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 607/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:44 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:44.372132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:44.372615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:44.377617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:44.378060 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:44.379068 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:44.379503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.529008 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2876bc-dc53-4877-841e-dd2927b4fcc6) Feb 07 04:53:47.530472 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2876bc-dc53-4877-841e-dd2927b4fcc6) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:47.532961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 123.868741 Feb 07 04:53:47.533701 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:47.533862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:47.534531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-fe28da31-1318-4a27-b219-53cf6ad48709 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:47.534531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.534531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.535009 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 530/1137] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:51:43 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 123871 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.541183 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.541787 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.550232 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.550992 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.552034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.552561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.570027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:53:47.570978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:47.571859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.035754 Feb 07 04:53:47.572506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (ip 10.222.0.13) !!! Feb 07 04:53:47.572506 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b (10.222.0.13) Feb 07 04:53:47.573255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-526add8b-8a7e-4d00-aa44-db01f6c9bbc2 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:47.573255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.573255 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.573691 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 531/1138] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:53:47 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 0 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.578201 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.579159 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.585360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.585811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.586596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.587034 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.615984 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 Feb 07 04:53:47.616525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:53:47.616525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:53:47.617102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-6b377864-7f8d-405d-a5d9-a0f502f6a885 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:53:47.617102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.617102 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.617357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 532/1139] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:53:47 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.621561 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.622204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.628110 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.628563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.629599 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.630031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.659397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 28310380-b13c-4436-8743-98b0f7ef3883 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:47.744424 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:47.766344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bff39ad2-11b7-4499-9f79-7655b34ab9b0) Feb 07 04:53:47.766988 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bff39ad2-11b7-4499-9f79-7655b34ab9b0) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:47.767835 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2" status: 400 len: 269 microversion: 2.1 time: 3.398910 Feb 07 04:53:47.768365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (ip 10.222.0.13) !!! Feb 07 04:53:47.768365 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 (10.222.0.13) Feb 07 04:53:47.768934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-714b854e-fe0b-489d-bab5-c5f139072503 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:53:47.768934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:47.768934 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:47.769167 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 608/1140] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:44 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883/os-volume_attachments/c2bf1dc9-1886-44cd-ba90-f9ae757958a2 => generated 0 bytes in 3400 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.773344 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.774776 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.783850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.784640 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.785456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.785904 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.806579 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-24ab5a98-53dd-44b5-bd3e-73b170203583) Feb 07 04:53:47.807407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-24ab5a98-53dd-44b5-bd3e-73b170203583) {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:47.808275 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.190158 Feb 07 04:53:47.808856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:47.808856 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:47.809684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-cd6bf425-e1cf-4cf5-a0b9-c5123b4df57e tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:47.809684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.809684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.809975 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 533/1141] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:47 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.814905 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.815515 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.821755 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.822109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.823263 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.823859 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.826152 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:47.838289 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:47.838878 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:47.839695 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.029001 Feb 07 04:53:47.840373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:47.840373 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:47.840942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-4de577ad-e4ac-4e3d-a9f0-e2623ec5ac4b tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:47.840942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.840942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.841173 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 534/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:47 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.845942 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2e58fcf6-5628-4cee-a52e-3e5adb41d3a7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b2b5940>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.866119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2e58fcf6-5628-4cee-a52e-3e5adb41d3a7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 204 len: 0 microversion: 2.20 time: 0.024057 Feb 07 04:53:47.866671 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:47.866671 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:47.867242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-2e58fcf6-5628-4cee-a52e-3e5adb41d3a7 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:47.867242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.867242 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.867511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 535/1143] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.871778 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.872687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.878355 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.879125 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.879991 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.880504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.903081 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 0.132840 Feb 07 04:53:47.903715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:47.903919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:47 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:47.904759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-69c94279-3320-4518-8677-48d5a72a95a5 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:47.904759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:47.904759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:47.905445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 609/1144] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:47 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.911560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.913450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.916488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048064 Feb 07 04:53:47.917013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:53:47.917013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:53:47.917584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-4aca75ef-ec11-4859-aeb7-8e1ef89cf9bb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:53:47.917584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:47.917584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:47.917864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 536/1145] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:53:47 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:47.920467 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.920924 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.921710 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.921917 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:47.922143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.922537 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:47.930386 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.930831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.931604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:47.932037 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:47.956243 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:47.998820 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Instance is already in deleting state, ignoring this request Feb 07 04:53:47.999645 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 0.081056 Feb 07 04:53:48.000164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:48.000164 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:48.000369 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:48.000742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-97c937d8-1f83-4fd5-bd65-d534c0c9b6bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:48.000742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:48.000742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:48.001000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 537/1146] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:47 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.005419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.006021 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.011274 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.011724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.012564 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.013011 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.026052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:48.026635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.027481 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.025684 Feb 07 04:53:48.027961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:48.027961 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:48.028589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-286fa7db-5b48-4a55-b77e-e9fb595ff4ee tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:48.028589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:48.028589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:48.028903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 538/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.033460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3145b9e1-8764-4438-9d6f-54150c459a4f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b425670>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.047420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-3145b9e1-8764-4438-9d6f-54150c459a4f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:48.048001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-3145b9e1-8764-4438-9d6f-54150c459a4f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.049458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-3145b9e1-8764-4438-9d6f-54150c459a4f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.019852 Feb 07 04:53:48.049888 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:48.050145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:48.050811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-3145b9e1-8764-4438-9d6f-54150c459a4f tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:48.050811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:48.050811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:48.051075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 539/1148] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.055303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.056158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.057342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7d571f29-9cf5-465c-8fc6-211785a972a7) Feb 07 04:53:48.058122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7d571f29-9cf5-465c-8fc6-211785a972a7) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.059095 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.152461 Feb 07 04:53:48.059612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:48.059612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:48.060218 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-f7bc099b-d85c-4f4f-8225-6f0b2093cf22 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:48.060218 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.060218 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.060503 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 610/1149] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:47 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.063765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.064430 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.064831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.065318 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.065790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.066449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.073421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.073793 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.074597 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.075112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.101215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049278 Feb 07 04:53:48.101732 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:53:48.101732 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:53:48.102303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-313b2dfd-6ec6-40bb-a84d-f72104837e05 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:53:48.102303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:48.102303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:48.102584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 540/1150] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.107377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.107927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.114498 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.116419 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.117398 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.117911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.147849 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:48.164691 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:48.210155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_db.api [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Performing DB retry for function nova.db.main.api.instance_update_and_get_original {{(pid=116492) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Feb 07 04:53:48.230128 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33190105-61c0-4672-85d5-ab1e3bd3b379) Feb 07 04:53:48.230743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33190105-61c0-4672-85d5-ab1e3bd3b379) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.231662 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.170367 Feb 07 04:53:48.232253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:48.232386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:48.232956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-1b1224de-7289-4e6f-911f-5a470676ab5d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:48.232956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.232956 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.233292 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 611/1151] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.238496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.239106 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.245343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.245795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.246571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.247008 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.261367 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:48.261940 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.262744 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.028661 Feb 07 04:53:48.263215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:48.263215 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:48.263770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-e4510c63-7488-44a4-959c-91ffe9a366da tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:48.263770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.263770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.264030 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 612/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.268448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-66336eca-4a35-4a08-bf72-39c7d6e74f2d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b29b430>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.284851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-66336eca-4a35-4a08-bf72-39c7d6e74f2d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:48.285445 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-66336eca-4a35-4a08-bf72-39c7d6e74f2d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.286251 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-66336eca-4a35-4a08-bf72-39c7d6e74f2d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.021489 Feb 07 04:53:48.286727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:48.286727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:48.287322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-66336eca-4a35-4a08-bf72-39c7d6e74f2d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:48.287322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.287322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.287628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 613/1153] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.291726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.292652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.298932 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.299387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.300213 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.300661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.329089 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040613 Feb 07 04:53:48.330105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:53:48.330105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:53:48.330688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-507c7e66-0f2f-4990-93f8-b2765412ceff tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:53:48.330688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.330688 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.330911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 614/1154] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.335105 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.335597 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.341059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.341514 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.342301 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.342742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.418433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:48.471760 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33bbdcf5-26e4-4bb5-b55f-2046a1791dcb) Feb 07 04:53:48.472400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33bbdcf5-26e4-4bb5-b55f-2046a1791dcb) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.473248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.141552 Feb 07 04:53:48.473754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:48.473754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:48.474325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-0427025e-1958-4fa8-b80a-8ec0c311f8c0 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:48.474325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.474325 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.474590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 615/1155] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.478769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.479266 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.485070 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.485529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.486334 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.486770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.499863 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:48.500475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.501354 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.025975 Feb 07 04:53:48.501836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:48.501836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:48.502398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-af1fac64-e244-4f25-b31b-f8f3e10e0b81 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:48.502398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.502398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.502666 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 616/1156] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.506930 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.507537 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.513013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.513473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.514252 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.514686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.527878 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:48.528489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.529305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.025922 Feb 07 04:53:48.529786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:48.529786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:48.530349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-05ce8e34-3200-4f63-9bfe-a4128a6d32dc tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:48.530349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.530349 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.530594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 617/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.535142 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b5793525-62bb-460e-8e79-8d8ae5ada97d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b4fa4c0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.544891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-b5793525-62bb-460e-8e79-8d8ae5ada97d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:48.545463 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b5793525-62bb-460e-8e79-8d8ae5ada97d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.546253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b5793525-62bb-460e-8e79-8d8ae5ada97d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.014930 Feb 07 04:53:48.546719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:48.546719 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:48.547265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-b5793525-62bb-460e-8e79-8d8ae5ada97d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:48.547265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.547265 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.547528 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 618/1158] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.551544 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.552441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.558507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.558960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.559740 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.560212 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.589288 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040884 Feb 07 04:53:48.589715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (ip 10.222.0.13) !!! Feb 07 04:53:48.589715 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments (10.222.0.13) Feb 07 04:53:48.590286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-312d43ee-57f2-454e-b5ee-11d1246be9d5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Unhandled error: OSError: write error Feb 07 04:53:48.590286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.590286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.590536 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 619/1159] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb/os-volume_attachments => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.722508 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-0dd6c7b7-bd1e-40da-b0fa-c8ca787530a9 req-4df10f8b-7aed-47b7-9015-6e0ace74784c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443b0913-1482-440f-b9e3-1fb5e8012d94", "name": "network-vif-deleted", "tag": "17109406-6d8f-40f6-9417-ddb7abe58df8"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:53:48.724065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:53:48.724065 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:53:48.730827 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-0dd6c7b7-bd1e-40da-b0fa-c8ca787530a9 req-4df10f8b-7aed-47b7-9015-6e0ace74784c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.731272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-0dd6c7b7-bd1e-40da-b0fa-c8ca787530a9 req-4df10f8b-7aed-47b7-9015-6e0ace74784c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.741490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-0dd6c7b7-bd1e-40da-b0fa-c8ca787530a9 req-4df10f8b-7aed-47b7-9015-6e0ace74784c service nova] Creating event network-vif-deleted:17109406-6d8f-40f6-9417-ddb7abe58df8 for instance 443b0913-1482-440f-b9e3-1fb5e8012d94 on hv-cinder-79963 Feb 07 04:53:48.746160 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-0dd6c7b7-bd1e-40da-b0fa-c8ca787530a9 req-4df10f8b-7aed-47b7-9015-6e0ace74784c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154711 Feb 07 04:53:48.746664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Feb 07 04:53:48.746772 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.13) Feb 07 04:53:48.747338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [req-0dd6c7b7-bd1e-40da-b0fa-c8ca787530a9 req-4df10f8b-7aed-47b7-9015-6e0ace74784c service nova] Unhandled error: OSError: write error Feb 07 04:53:48.747338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.747338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.747605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 620/1160] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.752870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.753437 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.759295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.759742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.760569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.760998 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.835161 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:48.885858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a140fe00-be97-4ae2-b123-32a017c8b33b) Feb 07 04:53:48.886473 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a140fe00-be97-4ae2-b123-32a017c8b33b) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.887317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.138810 Feb 07 04:53:48.887821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:48.887821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:48.888465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-9e6acd73-79aa-4715-867a-c23eb7bd1e61 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:48.888465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.888465 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.888729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 621/1161] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.893501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.893996 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.899769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.900273 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.901060 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.901504 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.915603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:48.916223 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.917040 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.027559 Feb 07 04:53:48.917514 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:48.917514 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:48.918084 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-561d063d-5914-433e-8e45-eb8d0f79f395 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:48.918084 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.918084 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.918336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 622/1162] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.922294 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.922916 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.928029 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.928515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.929319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.929763 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.942679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:48.943255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.944064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.025008 Feb 07 04:53:48.944525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:48.944525 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:48.945076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-41787d60-c968-4df6-ada8-0282158a3448 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:48.945076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.945076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.945319 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 623/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:48 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.949182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-35262650-3f0c-415f-8919-992cc73dc86e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b42c160>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.959750 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-35262650-3f0c-415f-8919-992cc73dc86e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:48.960372 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-35262650-3f0c-415f-8919-992cc73dc86e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:48.961168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-35262650-3f0c-415f-8919-992cc73dc86e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.015154 Feb 07 04:53:48.961636 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:48.961636 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:48.962191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-35262650-3f0c-415f-8919-992cc73dc86e tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:48.962191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:48.962191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:48.962434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 624/1164] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:48.966506 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:48.966999 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:48.973380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.973897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:48.974689 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:48.975132 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.053415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lazy-loading 'services' on Instance uuid 828835f3-29a3-4688-a490-18027416ef41 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:49.106569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-376c0cbf-cbbe-46fa-9e60-2e5f9864a2fa) Feb 07 04:53:49.107208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-376c0cbf-cbbe-46fa-9e60-2e5f9864a2fa) {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.108093 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2" status: 400 len: 269 microversion: 2.1 time: 0.144889 Feb 07 04:53:49.108662 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (ip 10.222.0.13) !!! Feb 07 04:53:49.108662 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 (10.222.0.13) Feb 07 04:53:49.109184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-51d549c6-cd14-4f44-9de3-5e0e2cfc2385 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Unhandled error: OSError: write error Feb 07 04:53:49.109184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.109184 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.109447 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 625/1165] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41/os-volume_attachments/392db1a2-81ae-4d13-9b5d-02ffa10ca8a2 => generated 0 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.113961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.114449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.120186 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.120637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.121406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.121838 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.134684 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.135253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.136035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.025655 Feb 07 04:53:49.136900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:49.136900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:49.137450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-bf2c7730-dbe8-438a-b0a0-4dc0b5b1be53 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:49.137450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.137450 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.137697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 626/1166] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.142362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.142967 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.148391 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.148836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.149608 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.150037 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.163405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:49.164006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.164829 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.026443 Feb 07 04:53:49.165310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:49.165310 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:49.165870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-0f0162de-f7bd-4675-8f78-978645907bc7 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:49.165870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.165870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.166118 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 627/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.170109 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6b2b927e-59d8-449a-872e-08ed24ed723d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b5f03a0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.180613 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-6b2b927e-59d8-449a-872e-08ed24ed723d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:49.181189 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-6b2b927e-59d8-449a-872e-08ed24ed723d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.181978 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-6b2b927e-59d8-449a-872e-08ed24ed723d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.015143 Feb 07 04:53:49.182429 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:49.182429 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:49.182977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-6b2b927e-59d8-449a-872e-08ed24ed723d tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:49.182977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.182977 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.183255 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 628/1168] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.187347 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.187838 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.194455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.194900 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.195674 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.196135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.209392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.210017 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.210831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.026918 Feb 07 04:53:49.211300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:49.211300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:49.211858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-54ec5b2d-da03-437c-82b4-4b192c5575eb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:49.211858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.211858 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.212150 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 629/1169] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.216950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.217549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.223722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.224206 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.224984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.225417 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.225790 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 204 len: 0 microversion: 2.1 time: 1.122281 Feb 07 04:53:49.226390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:49.226390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:49.227075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-1f4fd596-649e-41f8-9910-ef06724a71da tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:49.227075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.227075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.227318 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 541/1170] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:48 2022] DELETE /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 1124 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.231643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-142f7826-4a26-471b-b14f-4e86c15ee734 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917bd04d30>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.241386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:49.241753 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-142f7826-4a26-471b-b14f-4e86c15ee734 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:49.242090 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.242513 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-142f7826-4a26-471b-b14f-4e86c15ee734 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.243247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.030153 Feb 07 04:53:49.243457 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-142f7826-4a26-471b-b14f-4e86c15ee734 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.015137 Feb 07 04:53:49.244017 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:49.244017 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:49.244305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:49.244305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:49.244860 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-a5bcd08a-1c7f-4b9a-b63c-cde951b934bf tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:49.244860 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.244860 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.245126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-142f7826-4a26-471b-b14f-4e86c15ee734 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:49.245126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.245126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.245339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 630/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.245429 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 542/1172] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.249407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.250016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.250582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.251202 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.256681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.257131 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.257903 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.258018 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.258338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.258449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.259139 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.259581 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.271537 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:49.272149 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.272967 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.027066 Feb 07 04:53:49.273087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.273452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:49.273452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:49.273628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.274013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-947b14a6-deb4-4dfb-b4a9-f9aad86e7bd6 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:49.274013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.274013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.274286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 543/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.274419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.028333 Feb 07 04:53:49.274892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:49.274892 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:49.275456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-123d9d1f-fcef-450b-b5c9-e3efe3c437bb tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:49.275456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.275456 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.275707 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 631/1174] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.278303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e0142e44-a0a6-4b87-aa74-30d5796c1951 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b32a0d0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.279701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.280228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.287168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.288287 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.288505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-e0142e44-a0a6-4b87-aa74-30d5796c1951 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:49.289075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e0142e44-a0a6-4b87-aa74-30d5796c1951 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.289197 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.289524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.289862 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e0142e44-a0a6-4b87-aa74-30d5796c1951 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.014874 Feb 07 04:53:49.290330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:49.290330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:49.290882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-e0142e44-a0a6-4b87-aa74-30d5796c1951 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:49.290882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.290882 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.291127 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 544/1175] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.295013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.295615 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.301629 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.302080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.302853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.303285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.313338 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.316378 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.316958 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.317780 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.025959 Feb 07 04:53:49.318259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (ip 10.222.0.13) !!! Feb 07 04:53:49.318259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 (10.222.0.13) Feb 07 04:53:49.318832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-a10d99cc-c921-48ff-9e05-7c1105075a0b tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Unhandled error: OSError: write error Feb 07 04:53:49.318832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.318832 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.319135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 545/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.323115 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.323714 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 05b7e502-8196-48b1-a7ad-77ec28c6dbad] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.329068 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.330158 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.330932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.331367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.343921 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. Feb 07 04:53:49.344530 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 05b7e502-8196-48b1-a7ad-77ec28c6dbad could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.345382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad" status: 404 len: 111 microversion: 2.1 time: 0.025568 Feb 07 04:53:49.345885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (ip 10.222.0.13) !!! Feb 07 04:53:49.345885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad (10.222.0.13) Feb 07 04:53:49.346454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-912f0865-c2bc-4c74-bb1c-0f2b83db37b0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Unhandled error: OSError: write error Feb 07 04:53:49.346454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.346454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.346765 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 546/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/05b7e502-8196-48b1-a7ad-77ec28c6dbad => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.351016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-230d9081-efaa-4f74-a029-70dd49b67b66 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f918087aca0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.361278 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-230d9081-efaa-4f74-a029-70dd49b67b66 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:49.361868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-230d9081-efaa-4f74-a029-70dd49b67b66 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.362663 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-230d9081-efaa-4f74-a029-70dd49b67b66 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.015235 Feb 07 04:53:49.363124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (ip 10.222.0.13) !!! Feb 07 04:53:49.363124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 (10.222.0.13) Feb 07 04:53:49.363838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-230d9081-efaa-4f74-a029-70dd49b67b66 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Unhandled error: OSError: write error Feb 07 04:53:49.363838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.363838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.364141 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 547/1178] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 0 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.368162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.368689 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.375612 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.376136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.377449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.377897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.392551 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.114944 Feb 07 04:53:49.393111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 (ip 10.222.0.13) !!! Feb 07 04:53:49.393111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:53:49 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 (10.222.0.13) Feb 07 04:53:49.393743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: CRITICAL nova [None req-1c06de9a-cf7b-4be0-ad7d-71cc422ae5ce tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:53:49.393743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova OSError: write error Feb 07 04:53:49.393743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR nova Feb 07 04:53:49.394018 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 632/1179] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.398838 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.399526 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.405026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.405492 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.405620 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.406240 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.406672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.419405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.419984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.420820 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1350ea8b-e7b7-4017-a045-1a4648618ae3 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.025808 Feb 07 04:53:49.421342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 633/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.425484 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.425971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.431472 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.432002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.432810 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.433247 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.446617 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:53:49.447196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.448019 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5857dd78-df21-4923-b035-8c4c3648897e tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.025791 Feb 07 04:53:49.448575 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 634/1181] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.448805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.449584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.084677 Feb 07 04:53:49.450079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 (ip 10.222.0.13) !!! Feb 07 04:53:49.450079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:53:49 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 (10.222.0.13) Feb 07 04:53:49.450648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: CRITICAL nova [None req-28454c4c-bb05-4fd9-ae3a-b79ae65585bb tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Unhandled error: OSError: write error Feb 07 04:53:49.450648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova OSError: write error Feb 07 04:53:49.450648 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR nova Feb 07 04:53:49.450989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 548/1182] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Feb 07 04:53:49.452783 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5e1a7e2f-f28b-4de7-a733-416fce7a9147 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b29b550>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.455539 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.456030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.463012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.463430 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.463757 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-5e1a7e2f-f28b-4de7-a733-416fce7a9147 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:49.464302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.464427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5e1a7e2f-f28b-4de7-a733-416fce7a9147 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.464736 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.465199 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5e1a7e2f-f28b-4de7-a733-416fce7a9147 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.015738 Feb 07 04:53:49.465717 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 635/1183] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 132 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:53:49.469984 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.470591 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.477046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.477502 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.478294 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.478735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.491619 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.492118 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.492236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.493066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2fe7c27f-eb39-44c8-9337-d13036fc1523 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.026463 Feb 07 04:53:49.493732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 636/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.497968 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.498459 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.504648 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.505097 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.505870 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.506309 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.519376 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:53:49.519960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.520806 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-abc0988f-5940-4198-ad0f-91fee8550b1c tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.026182 Feb 07 04:53:49.521333 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 637/1185] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.525471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fc8bce07-f5ad-49ce-833d-a32737271821 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '.version_select at 0x7f917b29bdc0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.535381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-fc8bce07-f5ad-49ce-833d-a32737271821 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 Feb 07 04:53:49.535954 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fc8bce07-f5ad-49ce-833d-a32737271821 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Keypair tempest-keypair-1374816793 not found for user 9140d220db624cf89b9e010215040eb2 {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.536784 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fc8bce07-f5ad-49ce-833d-a32737271821 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793" status: 404 len: 132 microversion: 2.20 time: 0.014569 Feb 07 04:53:49.537500 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 638/1186] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374816793 => generated 132 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:53:49.541399 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.541889 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.542252 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.543199 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5d63a7be-e1aa-483b-ba9b-35d54727219e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.091440 Feb 07 04:53:49.543626 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 549/1187] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.548077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.548225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.548567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.548726 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.549322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.549773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.554143 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.554617 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.555385 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.555813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.569066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.569643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.570445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-927b869a-fb91-49dc-a8fe-9591cbdbe689 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.025743 Feb 07 04:53:49.570968 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 550/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.573615 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.575234 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.575805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.581872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.582320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.583081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.583514 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.596251 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:53:49.596821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.597618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-48b1623a-a667-4823-b029-5e8153b13f3a tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.025647 Feb 07 04:53:49.598134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 551/1189] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.602348 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.602834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.608331 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.608795 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.609557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.609988 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.615825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.compute.api [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.616623 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-a2ee6466-18ac-46a4-a30e-0ab981a13f07 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.078454 Feb 07 04:53:49.617178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 639/1190] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.621441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.621935 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.627844 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.628411 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.629483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.629955 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.634285 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.654489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.677046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.677874 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5f089523-ea27-4887-9cc8-79e3670d391e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.078740 Feb 07 04:53:49.678754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 552/1191] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.682885 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.683491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.689518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.690003 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.690776 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.691210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.705282 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.705618 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.706742 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-991dc1b1-eeaf-414f-ad53-a40771de9405 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.027369 Feb 07 04:53:49.707293 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 553/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.711682 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.712039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.717779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.718227 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.719005 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.719439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.733046 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:53:49.733635 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.734473 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-766c6144-f745-4574-a050-52e3e391d2c0 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.026281 Feb 07 04:53:49.735027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 554/1193] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.739972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-95fc66a1-2660-4ac6-b0ee-144a25c4ac41 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 204 len: 0 microversion: 2.1 time: 0.121561 Feb 07 04:53:49.740548 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.740548 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.740947 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 640/1194] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.746977 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.747382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.747536 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.748404 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.748532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.748632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.758812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.760192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.761478 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.761942 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.775070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.787850 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.817806 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.818724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7509d69c-2f51-4e5e-b5c2-b1471c50e435 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.082801 Feb 07 04:53:49.819280 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 555/1195] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.823543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.824172 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] [instance: 443b0913-1482-440f-b9e3-1fb5e8012d94] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.829559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.830006 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.830781 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.831215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.831625 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.compute.api [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.832475 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0e4e0993-7f6e-46dd-bbd3-83e3a2574fc5 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 204 len: 0 microversion: 2.1 time: 0.090286 Feb 07 04:53:49.833022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 641/1196] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.837208 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.837697 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.842906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.843361 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.844119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] HTTP exception thrown: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. Feb 07 04:53:49.844253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.844570 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.844699 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Returning 404 to user: Instance 443b0913-1482-440f-b9e3-1fb5e8012d94 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.845532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-4412573d-741a-4821-8ab5-07e180ee876c tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94" status: 404 len: 111 microversion: 2.1 time: 0.025348 Feb 07 04:53:49.846052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 556/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/443b0913-1482-440f-b9e3-1fb5e8012d94 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.850229 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.850719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.856345 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.856798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.857596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.857741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:53:49.858019 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.858446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.859599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-15c60065-e40f-4d3b-9935-fa6a4386561d tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.025409 Feb 07 04:53:49.860402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 642/1198] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.865295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.865792 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.872068 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.872569 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.873358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.873782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.886616 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.898628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.931324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.compute.api [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.932316 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-79d9b94f-80f0-4a75-bd0d-c215cad93e4d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 204 len: 0 microversion: 2.1 time: 0.085335 Feb 07 04:53:49.936353 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 557/1199] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.937628 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.938218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.944730 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.945275 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.946155 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.947163 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.951476 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.compute.api [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Instance is already in deleting state, ignoring this request Feb 07 04:53:49.952626 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e6f9dd78-3b8f-4b27-a847-b05f9b7fb21e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 204 len: 0 microversion: 2.1 time: 0.090796 Feb 07 04:53:49.954578 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 643/1200] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:49.959104 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.959712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [instance: 167dea27-bb6f-4570-bce1-655c26a20dbd] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.965461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.965908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.966679 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.967311 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.978179 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:53:49.981154 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] HTTP exception thrown: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. Feb 07 04:53:49.981741 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Returning 404 to user: Instance 167dea27-bb6f-4570-bce1-655c26a20dbd could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:49.982822 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c9e75483-6a6f-47e8-a1ea-b9561ea5cab1 tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd" status: 404 len: 111 microversion: 2.1 time: 0.026968 Feb 07 04:53:49.983564 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 644/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/167dea27-bb6f-4570-bce1-655c26a20dbd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:49.991488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:49.992205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:49.998343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:49.998923 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:49.999759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:50.000277 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:50.090360 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c3294062-6496-4142-9c16-8dca1f88123a tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 204 len: 0 microversion: 2.1 time: 0.155891 Feb 07 04:53:50.091225 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 558/1202] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:53:49 2022] DELETE /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:53:50.098641 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:50.099838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:50.106259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:50.106794 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:50.107633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:50.108152 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:50.183488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:50.191069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5db7eedb-d1fe-4609-8d6f-db20098fd5ae tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1514 microversion: 2.1 time: 0.206527 Feb 07 04:53:50.191642 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 645/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:49 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:50.200599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f69dd146-d612-421d-99c2-4f2581553260 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] Calling method '.version_select at 0x7f917b335dc0>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:50.221781 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f69dd146-d612-421d-99c2-4f2581553260 tempest-TestShelveInstance-938240615 tempest-TestShelveInstance-938240615-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1825503725" status: 202 len: 0 microversion: 2.1 time: 0.024671 Feb 07 04:53:50.222360 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 646/1204] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Feb 7 04:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1825503725 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:53:50.236362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:50.237032 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:50.243406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:50.243908 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:50.244896 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:50.245436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:50.255540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:50.264441 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-04886c04-bf91-46c1-b72b-e5b5c9decf16 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1718 microversion: 2.1 time: 0.171730 Feb 07 04:53:50.265024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 559/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:50 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:50.388422 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:50.396961 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d5f95b14-2476-4769-82ba-45aafe631c27 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1601 microversion: 2.1 time: 0.173549 Feb 07 04:53:50.397560 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 647/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:50 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:51.209057 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:51.209758 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:51.215905 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.216452 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.217316 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.217748 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.285773 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:51.286950 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:51.293069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.293519 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.294416 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.294888 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.444918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:51.455903 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ed481d8a-b53e-4226-bf05-f2b7603ef30c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 200 len: 1514 microversion: 2.1 time: 0.248989 Feb 07 04:53:51.464633 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 560/1207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:51 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:51.467870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:51.468531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:51.475350 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.475994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.476819 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.477423 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.697284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:51.712637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-aa215194-833d-46ba-a793-4a788f09e37a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1718 microversion: 2.1 time: 0.432572 Feb 07 04:53:51.720732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 648/1208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:51 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1718 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:53:51.727223 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-4427931c-4180-47a4-b79d-6ca1aa3c2263 req-4a7a3098-95a6-4941-a648-66131c002742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28310380-b13c-4436-8743-98b0f7ef3883", "name": "network-vif-deleted", "tag": "d6ff01d2-3879-49d1-9db0-2165e670c23a"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:53:51.730087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:53:51.730087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:53:51.738590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-4427931c-4180-47a4-b79d-6ca1aa3c2263 req-4a7a3098-95a6-4941-a648-66131c002742 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:51.739388 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-4427931c-4180-47a4-b79d-6ca1aa3c2263 req-4a7a3098-95a6-4941-a648-66131c002742 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:51.750186 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:51.760464 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-4427931c-4180-47a4-b79d-6ca1aa3c2263 req-4a7a3098-95a6-4941-a648-66131c002742 service nova] Creating event network-vif-deleted:d6ff01d2-3879-49d1-9db0-2165e670c23a for instance 28310380-b13c-4436-8743-98b0f7ef3883 on hv-cinder-79963 Feb 07 04:53:51.762985 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-7219c5d5-6f63-4548-bb40-fc7a00ba7e11 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1601 microversion: 2.1 time: 0.304974 Feb 07 04:53:51.764940 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 561/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:51 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1601 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:51.787449 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-4427931c-4180-47a4-b79d-6ca1aa3c2263 req-4a7a3098-95a6-4941-a648-66131c002742 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064888 Feb 07 04:53:51.790443 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 649/1210] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:53:52.422478 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-cf433cef-af8e-4039-a805-7ca484de5db5 req-aab31e6c-e4ca-485d-8dd4-0b442a06e5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb", "name": "network-vif-deleted", "tag": "16d71b5a-130e-4a2a-ba8d-452f52e1fb61"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:53:52.424783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:53:52.424783 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:53:52.443950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-cf433cef-af8e-4039-a805-7ca484de5db5 req-aab31e6c-e4ca-485d-8dd4-0b442a06e5f7 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.445126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-cf433cef-af8e-4039-a805-7ca484de5db5 req-aab31e6c-e4ca-485d-8dd4-0b442a06e5f7 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.465640 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-cf433cef-af8e-4039-a805-7ca484de5db5 req-aab31e6c-e4ca-485d-8dd4-0b442a06e5f7 service nova] Creating event network-vif-deleted:16d71b5a-130e-4a2a-ba8d-452f52e1fb61 for instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb on hv-cinder-79963 Feb 07 04:53:52.472611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-cf433cef-af8e-4039-a805-7ca484de5db5 req-aab31e6c-e4ca-485d-8dd4-0b442a06e5f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165453 Feb 07 04:53:52.473980 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 562/1211] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:53:52.486873 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:52.487911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 28310380-b13c-4436-8743-98b0f7ef3883] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:52.498548 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.499364 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.500426 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.501066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.525295 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Instance 28310380-b13c-4436-8743-98b0f7ef3883 could not be found. Feb 07 04:53:52.526192 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 404 to user: Instance 28310380-b13c-4436-8743-98b0f7ef3883 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:52.527304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4e5d7fe8-ece6-4ab3-9f6e-b9f1f1d13f1c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883" status: 404 len: 111 microversion: 2.1 time: 0.057435 Feb 07 04:53:52.534375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 650/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:52 2022] GET /compute/v2.1/servers/28310380-b13c-4436-8743-98b0f7ef3883 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:52.731022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:52.732097 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:52.745808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.749902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.751044 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.752463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.789387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:52.794649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:52.806944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.807403 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.808221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.808658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.842900 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:52.843367 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:52.843835 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lazy-loading 'fault' on Instance uuid 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:53:52.957253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:52.967911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fd4a8c7a-da35-4b03-8146-b985310827fa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 200 len: 1461 microversion: 2.1 time: 0.241754 Feb 07 04:53:52.970022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 563/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:52 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 1461 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:53.072571 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c9f8b7b4cd4e45a33d4765769e49fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4e3629fd9463cbb7ec690e5290d6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:53:53.081220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-96fcb7d5-1a1c-4ff5-9473-64ac7e235605 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 200 len: 1390 microversion: 2.1 time: 0.301069 Feb 07 04:53:53.084196 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 651/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:52 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 1390 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:53:53.826959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-40129f79-c5ea-4824-a336-964a7ecaa829 req-de44c799-cb66-4a7f-9004-133357ba9e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828835f3-29a3-4688-a490-18027416ef41", "name": "network-vif-deleted", "tag": "8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:53:53.828651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:53:53.828651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:53:53.836670 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-40129f79-c5ea-4824-a336-964a7ecaa829 req-de44c799-cb66-4a7f-9004-133357ba9e15 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:53.837544 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-40129f79-c5ea-4824-a336-964a7ecaa829 req-de44c799-cb66-4a7f-9004-133357ba9e15 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:53.853474 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-40129f79-c5ea-4824-a336-964a7ecaa829 req-de44c799-cb66-4a7f-9004-133357ba9e15 service nova] Creating event network-vif-deleted:8cfafd2b-9df7-4cf4-aef4-b27dd4f3a494 for instance 828835f3-29a3-4688-a490-18027416ef41 on hv-cinder-79963 Feb 07 04:53:53.861081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-40129f79-c5ea-4824-a336-964a7ecaa829 req-de44c799-cb66-4a7f-9004-133357ba9e15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036825 Feb 07 04:53:53.862852 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 564/1215] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:53:53.986901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:53.988209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:53.995173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:53.995759 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:53.997058 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:53.997515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:54.027520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] HTTP exception thrown: Instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb could not be found. Feb 07 04:53:54.028582 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Returning 404 to user: Instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:54.029421 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fb24d52a-f49a-437f-a851-2e0ce795ab4b tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 404 len: 111 microversion: 2.1 time: 0.046910 Feb 07 04:53:54.029971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 652/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:53 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:54.051522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-94afb369-3dec-4fa6-b26d-be7ef5d06c68 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '.version_select at 0x7f917b387040>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:54.086430 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-94afb369-3dec-4fa6-b26d-be7ef5d06c68 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-125670800" status: 202 len: 0 microversion: 2.1 time: 0.051287 Feb 07 04:53:54.087329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 565/1217] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Feb 7 04:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-125670800 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:53:54.101633 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:54.102276 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] [instance: 828835f3-29a3-4688-a490-18027416ef41] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:53:54.109735 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:54.110191 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:54.111653 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:54.112081 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:54.126457 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] HTTP exception thrown: Instance 828835f3-29a3-4688-a490-18027416ef41 could not be found. Feb 07 04:53:54.127722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Returning 404 to user: Instance 828835f3-29a3-4688-a490-18027416ef41 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:53:54.129250 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-82255b30-2227-4376-ae26-e78262ebb087 tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41" status: 404 len: 111 microversion: 2.1 time: 0.030818 Feb 07 04:53:54.130495 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 653/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:54 2022] GET /compute/v2.1/servers/828835f3-29a3-4688-a490-18027416ef41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:53:54.138470 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fd26b250-8605-428c-a38f-61d72fd0189d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] Calling method '.version_select at 0x7f917b2111f0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:54.165945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fd26b250-8605-428c-a38f-61d72fd0189d tempest-TestMinimumBasicScenario-1773848419 tempest-TestMinimumBasicScenario-1773848419-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1861838718" status: 202 len: 0 microversion: 2.1 time: 0.031299 Feb 07 04:53:54.166894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 566/1219] 10.222.0.13 () {58 vars in 1271 bytes} [Mon Feb 7 04:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1861838718 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:53:54.887387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c3495374-8a78-4f86-8093-373a296098b1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: .version_select at 0x7f917b5a8d30>, body: {"keypair": {"name": "tempest-keypair-66233011"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:53:54.912952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-c3495374-8a78-4f86-8093-373a296098b1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:53:54.935316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-c3495374-8a78-4f86-8093-373a296098b1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for user 4ecfb108826147368ceb199e2e4da59e and project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:53:55.311787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-c3495374-8a78-4f86-8093-373a296098b1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:53:55.316324 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-c3495374-8a78-4f86-8093-373a296098b1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for user 4ecfb108826147368ceb199e2e4da59e and project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'key_pairs'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:53:55.330370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c3495374-8a78-4f86-8093-373a296098b1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.449752 Feb 07 04:53:55.336271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 654/1220] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Feb 7 04:53:54 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:53:58.277165 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-188182518", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "411cc7d3-f09c-4e43-9d10-7530e81fadb4"}], "security_groups": [{"name": "tempest-securitygroup--1606177348"}], "key_name": "tempest-keypair-66233011", "user_data": "}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:53:58.594838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] validate_networks() for [('411cc7d3-f09c-4e43-9d10-7530e81fadb4', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:53:59.560136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:53:59.561420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:53:59.562296 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:53:59.562950 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:53:59.564604 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:53:59.581850 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:59.585749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:59.586668 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:53:59.587421 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:53:59.638826 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:53:59.647727 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Getting quotas for user 4ecfb108826147368ceb199e2e4da59e and project 5f954da0f8764195bc7bb449ea7c7412. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:53:59.670717 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:53:59.677171 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:53:59.809647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-85d508f0-b645-4235-b9a4-fdd98864b322 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.537289 Feb 07 04:53:59.815697 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 567/1221] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:53:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:53:59.822110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-5986ac0c-2899-4f9f-8511-5f3ad5197a5e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:53:59.822733 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-5986ac0c-2899-4f9f-8511-5f3ad5197a5e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:00.053430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-5986ac0c-2899-4f9f-8511-5f3ad5197a5e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:00.060012 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-5986ac0c-2899-4f9f-8511-5f3ad5197a5e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1235 microversion: 2.1 time: 0.242703 Feb 07 04:54:00.069914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 655/1222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:53:59 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1235 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:01.078099 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:01.078857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:01.085945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:01.086402 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:01.087577 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:01.088080 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:01.155684 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:01.164315 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d345b4cd-4872-470f-ad93-00a749483a58 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1239 microversion: 2.1 time: 0.090682 Feb 07 04:54:01.164892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 568/1223] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:01 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:02.182280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:02.182839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:02.193429 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:02.194314 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:02.197470 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:02.198248 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:02.274474 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:02.284675 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-779ed159-3752-4364-8993-839a98e6d863 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1239 microversion: 2.1 time: 0.106076 Feb 07 04:54:02.295381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 656/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:02 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1239 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:03.303091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:03.304396 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:03.314311 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:03.314847 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:03.315849 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:03.316458 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:03.390087 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:03.397879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e23cd613-2679-430b-b9d7-c2ef00ea20cb tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1287 microversion: 2.1 time: 0.098874 Feb 07 04:54:03.398454 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 569/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:03 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:04.415049 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:04.415868 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:04.423328 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:04.424035 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:04.425077 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:04.425742 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:04.499775 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:04.508834 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e5a99347-ec0a-45fb-8a7e-020e7d9eeb83 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1293 microversion: 2.1 time: 0.097319 Feb 07 04:54:04.510002 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 657/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:04 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:05.108645 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-389013987", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "99875bed-ca00-4d1c-bf5e-abfbd81f5ac7"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:05.159041 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] validate_networks() for [('99875bed-ca00-4d1c-bf5e-abfbd81f5ac7', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:54:05.476242 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-e72e33cf-60c2-4096-8e04-0c6422eff277 req-003acb23-2a28-466b-9cfd-107c3a86fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3200f43-e8d2-4ce0-bb56-05d458252ede", "tag": "251daae1-beca-4649-8675-6b45ef72321b"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:05.480695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:54:05.480695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:54:05.505538 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-e72e33cf-60c2-4096-8e04-0c6422eff277 req-003acb23-2a28-466b-9cfd-107c3a86fa2b service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:05.507576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-e72e33cf-60c2-4096-8e04-0c6422eff277 req-003acb23-2a28-466b-9cfd-107c3a86fa2b service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:05.527230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-e72e33cf-60c2-4096-8e04-0c6422eff277 req-003acb23-2a28-466b-9cfd-107c3a86fa2b service nova] Creating event network-changed:251daae1-beca-4649-8675-6b45ef72321b for instance c3200f43-e8d2-4ce0-bb56-05d458252ede on hv-cinder-79963 Feb 07 04:54:05.533336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-e72e33cf-60c2-4096-8e04-0c6422eff277 req-003acb23-2a28-466b-9cfd-107c3a86fa2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067508 Feb 07 04:54:05.533948 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 658/1227] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:05.543994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:05.544726 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:05.551474 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:54:05.551897 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:54:05.552420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:54:05.552826 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:54:05.553233 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:54:05.559363 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:05.560205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:05.561157 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:05.561749 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:05.566501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:05.567052 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:05.568194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:05.568739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:05.592390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Getting quotas for project ef628b18fee54b219122e9accae291b4. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:54:05.596770 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Getting quotas for user b509b217add444b191e92b67f18614cd and project ef628b18fee54b219122e9accae291b4. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:54:05.608240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:54:05.611654 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:54:05.666113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-57714537-764b-427f-9e6d-941ce8caa3f2 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561028 Feb 07 04:54:05.666932 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 570/1228] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:54:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:54:05.678283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-301e78c4-7e23-4afa-a8a9-3bf1cd9f3098 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:05.680518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-301e78c4-7e23-4afa-a8a9-3bf1cd9f3098 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:05.760250 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-301e78c4-7e23-4afa-a8a9-3bf1cd9f3098 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:05.768294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-301e78c4-7e23-4afa-a8a9-3bf1cd9f3098 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1218 microversion: 2.1 time: 0.093281 Feb 07 04:54:05.769039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 571/1229] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:05 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:05.819389 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:05.830155 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-423d0dfe-eb18-46fe-8861-442ce3e4ca11 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.293445 Feb 07 04:54:05.830913 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 659/1230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:05 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:06.785486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:06.786773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:06.793904 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:06.794348 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:06.795124 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:06.795557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:06.852812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:06.853880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:06.855949 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:06.861026 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:06.861796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:06.862795 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:06.863301 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:06.865284 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a7fadbca-e18b-48bf-b6f3-231500d0f647 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1270 microversion: 2.1 time: 0.084040 Feb 07 04:54:06.865857 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 572/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:06 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:07.110625 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:07.118652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2dafe55e-4081-4d87-a0ad-65495c057d5f tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.269500 Feb 07 04:54:07.119538 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 660/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:06 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:07.883414 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:07.884177 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:07.890395 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:07.890843 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:07.891678 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:07.892134 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:08.027335 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:08.034710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d3d3c7d9-cb52-4219-8046-51097c4f3fde tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.155015 Feb 07 04:54:08.035292 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 573/1233] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:07 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:08.135854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:08.136433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:08.142559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:08.143006 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:08.143782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:08.144241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:08.301589 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-3705b556-6c4b-43bb-9353-7c93800ed036 req-03c41471-e018-4d04-b726-2377b3940fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad211db-78a9-43e7-a075-8e1f11829a1c", "tag": "524fc619-8a6e-44d4-a3b6-6015664a54f8"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:08.303249 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:54:08.303249 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:54:08.310805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-3705b556-6c4b-43bb-9353-7c93800ed036 req-03c41471-e018-4d04-b726-2377b3940fbf service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:08.311335 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-3705b556-6c4b-43bb-9353-7c93800ed036 req-03c41471-e018-4d04-b726-2377b3940fbf service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:08.322608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-3705b556-6c4b-43bb-9353-7c93800ed036 req-03c41471-e018-4d04-b726-2377b3940fbf service nova] Creating event network-changed:524fc619-8a6e-44d4-a3b6-6015664a54f8 for instance 2ad211db-78a9-43e7-a075-8e1f11829a1c on hv-cinder-79963 Feb 07 04:54:08.327526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-3705b556-6c4b-43bb-9353-7c93800ed036 req-03c41471-e018-4d04-b726-2377b3940fbf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Feb 07 04:54:08.328298 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 574/1234] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:54:08.392069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:08.399164 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0126a161-aa7b-4a72-8e4e-60e4ee1d6b33 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.267093 Feb 07 04:54:08.399734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 661/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:08 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:09.052257 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:09.052883 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:09.058854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:09.059307 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:09.060119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:09.060557 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:09.197740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:09.205838 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cb2e0b47-d2c9-4056-8e62-1c41856f27c0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.158313 Feb 07 04:54:09.206412 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 575/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:09 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:09.416440 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:09.417053 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:09.423732 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:09.424204 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:09.424980 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:09.425410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:09.610944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:09.618098 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c8d91b62-4e5e-4403-b588-f2fd737283d4 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.205321 Feb 07 04:54:09.618664 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 662/1237] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:09 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:10.223053 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:10.223608 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:10.229853 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:10.230308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:10.231107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:10.231548 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:10.369890 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:10.377575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-72450296-5888-442a-a6d9-dacf5f03c86e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.159042 Feb 07 04:54:10.378436 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 576/1238] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:10 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:10.634885 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:10.635659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:10.642533 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:10.642978 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:10.643748 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:10.644211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:10.774839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:10.782058 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-90fc05b0-cde8-4ec4-a034-9a4550a10f37 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.150755 Feb 07 04:54:10.782655 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 663/1239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:10 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:11.394872 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:11.395476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:11.401766 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:11.402210 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:11.402976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:11.403420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:11.529409 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:11.536499 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a2bdfe9c-a857-444d-9c45-8d004de45546 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.145818 Feb 07 04:54:11.537064 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 577/1240] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:11 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:11.799173 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:11.799779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:11.806011 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:11.806464 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:11.807239 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:11.807676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:11.945852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:11.953568 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e72bce9e-bc45-4d22-8277-bd8a5cc356f0 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.158046 Feb 07 04:54:11.954402 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 664/1241] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:11 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:54:12.450491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-551ae772-9fc7-44dc-919f-482cc45a68bf req-07eff991-cf7b-40c2-a566-a5b8a90b8faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3200f43-e8d2-4ce0-bb56-05d458252ede", "name": "network-vif-plugged", "status": "completed", "tag": "251daae1-beca-4649-8675-6b45ef72321b"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:12.451996 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:54:12.451996 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:54:12.458680 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-551ae772-9fc7-44dc-919f-482cc45a68bf req-07eff991-cf7b-40c2-a566-a5b8a90b8faa service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:12.459130 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-551ae772-9fc7-44dc-919f-482cc45a68bf req-07eff991-cf7b-40c2-a566-a5b8a90b8faa service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:12.469725 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-551ae772-9fc7-44dc-919f-482cc45a68bf req-07eff991-cf7b-40c2-a566-a5b8a90b8faa service nova] Creating event network-vif-plugged:251daae1-beca-4649-8675-6b45ef72321b for instance c3200f43-e8d2-4ce0-bb56-05d458252ede on hv-cinder-79963 Feb 07 04:54:12.474744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-551ae772-9fc7-44dc-919f-482cc45a68bf req-07eff991-cf7b-40c2-a566-a5b8a90b8faa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155776 Feb 07 04:54:12.475310 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 578/1242] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:12.553412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:12.554014 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:12.559904 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:12.560379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:12.561153 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:12.561584 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:12.721235 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:12.728701 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-71179edc-a2f6-4344-83ad-b1ca44fcc7dd tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.178898 Feb 07 04:54:12.729458 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 665/1243] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:12 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:12.971269 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:12.971994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:12.978000 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:12.978445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:12.979212 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:12.979643 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:13.112724 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:13.120027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-36c5517c-df75-423d-8c71-2878866af2b9 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.153275 Feb 07 04:54:13.120667 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 579/1244] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:12 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:13.745936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:13.746490 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:13.753357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:13.754056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:13.754821 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:13.755251 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:13.886914 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:13.894825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b33d81cd-f1bd-4881-b1db-1bdbccf74a6b tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.152598 Feb 07 04:54:13.895386 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 666/1245] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:13 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:14.136887 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:14.137504 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:14.144283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:14.144719 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:14.145510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:14.145951 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:14.278191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:14.285526 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-70209dcb-9df1-4283-928d-1a5c06451c43 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1361 microversion: 2.1 time: 0.152551 Feb 07 04:54:14.286119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 580/1246] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:14 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:14.491787 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-8952d822-0d2c-4e85-9c5d-933d8103bb39 req-3cb7502d-c0f5-4415-8791-baf1ba0c9caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad211db-78a9-43e7-a075-8e1f11829a1c", "name": "network-vif-plugged", "status": "completed", "tag": "524fc619-8a6e-44d4-a3b6-6015664a54f8"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:14.494044 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:54:14.494044 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:54:14.508217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-8952d822-0d2c-4e85-9c5d-933d8103bb39 req-3cb7502d-c0f5-4415-8791-baf1ba0c9caa service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:14.508217 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-8952d822-0d2c-4e85-9c5d-933d8103bb39 req-3cb7502d-c0f5-4415-8791-baf1ba0c9caa service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:14.517415 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-8952d822-0d2c-4e85-9c5d-933d8103bb39 req-3cb7502d-c0f5-4415-8791-baf1ba0c9caa service nova] Creating event network-vif-plugged:524fc619-8a6e-44d4-a3b6-6015664a54f8 for instance 2ad211db-78a9-43e7-a075-8e1f11829a1c on hv-cinder-79963 Feb 07 04:54:14.522541 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-8952d822-0d2c-4e85-9c5d-933d8103bb39 req-3cb7502d-c0f5-4415-8791-baf1ba0c9caa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035754 Feb 07 04:54:14.523135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 667/1247] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:14.910930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:14.911535 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:14.917260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:14.917732 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:14.918500 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:14.918930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:15.052022 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:15.059213 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-83b398ca-1068-4959-8a3c-27173322fa62 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.152471 Feb 07 04:54:15.059779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 581/1248] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:14 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:15.303211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:15.303841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:15.309941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:15.310396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:15.311181 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:15.311629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:15.444880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:15.452085 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-72370cb7-40e4-4437-bec5-d6227dbb7b15 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1547 microversion: 2.1 time: 0.153410 Feb 07 04:54:15.452656 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 668/1249] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:15 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:15.468965 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:15.469440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:15.476331 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:15.476779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:15.477559 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:15.477989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:15.558195 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-08c5ee0f-ca67-4095-97f5-f87f4434f199 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092906 Feb 07 04:54:15.558777 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 582/1250] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Feb 7 04:54:15 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:54:16.083321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:16.083321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:16.083321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:16.083321 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:16.083720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:16.084263 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:16.219880 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:16.227686 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1f1542bd-96f1-4a23-b6de-d1b73830df8e tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1318 microversion: 2.1 time: 0.155543 Feb 07 04:54:16.228304 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 669/1251] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:16 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:16.711081 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:16.711692 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:16.713013 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-349bba1c-cf14-47be-9fe8-8ac8fe70fc2b req-05a3b9c5-c053-42bb-8093-dd0f692aebd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3200f43-e8d2-4ce0-bb56-05d458252ede", "tag": "251daae1-beca-4649-8675-6b45ef72321b"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:16.714594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:54:16.714594 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:54:16.718371 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:16.719021 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:16.720602 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:16.721048 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:16.722989 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-349bba1c-cf14-47be-9fe8-8ac8fe70fc2b req-05a3b9c5-c053-42bb-8093-dd0f692aebd1 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:16.723515 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-349bba1c-cf14-47be-9fe8-8ac8fe70fc2b req-05a3b9c5-c053-42bb-8093-dd0f692aebd1 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:16.735059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-349bba1c-cf14-47be-9fe8-8ac8fe70fc2b req-05a3b9c5-c053-42bb-8093-dd0f692aebd1 service nova] Creating event network-changed:251daae1-beca-4649-8675-6b45ef72321b for instance c3200f43-e8d2-4ce0-bb56-05d458252ede on hv-cinder-79963 Feb 07 04:54:16.739960 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-349bba1c-cf14-47be-9fe8-8ac8fe70fc2b req-05a3b9c5-c053-42bb-8093-dd0f692aebd1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030883 Feb 07 04:54:16.741069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 670/1252] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:16.863839 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:16.871325 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-50c1ed20-c19c-4d74-88d7-2f66a3452be6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1547 microversion: 2.1 time: 0.164659 Feb 07 04:54:16.872330 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 583/1253] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:16 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:17.245079 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:17.245786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:17.252009 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:17.252494 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:17.253280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:17.254585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:17.398546 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:17.405953 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e453057a-ee2e-4dac-a93b-5b090e0b77db tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1507 microversion: 2.1 time: 0.164962 Feb 07 04:54:17.406522 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 671/1254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:17 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:17.422518 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d3880b8-a549-47f4-8423-6b667746ceb2", "device": "/dev/sdb"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:17.424368 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:17.430145 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:17.430598 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:17.431377 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:17.431814 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:17.683573 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-aabcc36a-bc53-4c3b-b726-a53821f92fd0 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "POST /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264791 Feb 07 04:54:17.684232 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 584/1255] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:54:17 2022] POST /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 07 04:54:17.889436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:17.890159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:17.896777 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:17.897241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:17.898025 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:17.898471 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:18.040314 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:18.047557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-64ab1925-9d3f-4c84-b48c-8adeac1c5510 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1666 microversion: 2.1 time: 0.161876 Feb 07 04:54:18.048230 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 672/1256] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:17 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:54:18.065211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:18.065796 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:18.071743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:18.072245 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:18.073060 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:18.073505 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:18.096313 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-0a0693a1-4ab9-4b13-ad46-8c66d6e21997 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/ips" status: 200 len: 146 microversion: 2.1 time: 0.036007 Feb 07 04:54:18.096813 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 585/1257] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Feb 7 04:54:18 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:19.391565 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a9ba551-4e49-4530-8cfa-e44981b66911"}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:19.392643 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:19.398786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:19.399229 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:19.400004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:19.400460 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:19.667655 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4acc7e8a-012f-413e-adaa-f50daefec13c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279626 Feb 07 04:54:19.668315 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 673/1258] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:54:19 2022] POST /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:37.660972 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:37.661948 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:37.668092 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:37.668549 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:37.669324 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:37.669762 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:37.698030 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c76f8a74-c973-47a3-a266-d029c8007c2d tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040769 Feb 07 04:54:37.698576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 586/1259] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:54:37 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:37.709144 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:37.709729 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:37.716201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:37.716652 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:37.717432 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:37.717869 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:37.746559 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0928d543-15f5-4f37-9e98-2361e69ecc21 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/7a9ba551-4e49-4530-8cfa-e44981b66911" status: 200 len: 194 microversion: 2.1 time: 0.041492 Feb 07 04:54:37.751727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 674/1260] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Feb 7 04:54:37 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/7a9ba551-4e49-4530-8cfa-e44981b66911 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:39.052407 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f9cfe0c-28a5-43d6-befa-384035a19710"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:39.053451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:39.059540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:39.059986 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:39.060781 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:39.061211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:39.320274 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-00ce1fca-ede9-431b-88bf-b3e3862b64aa tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "POST /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271698 Feb 07 04:54:39.320889 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 587/1261] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Feb 7 04:54:39 2022] POST /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:39.941841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:39.942722 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:39.949261 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:39.949779 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:39.950505 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:39.950931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:40.027493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lazy-loading 'services' on Instance uuid 2ad211db-78a9-43e7-a075-8e1f11829a1c {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:54:40.097066 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fcfd4968-f572-4aeb-a379-3953586d99b8 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c/os-volume_attachments/2d3880b8-a549-47f4-8423-6b667746ceb2" status: 202 len: 0 microversion: 2.1 time: 0.160559 Feb 07 04:54:40.097650 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 675/1262] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:54:39 2022] DELETE /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c/os-volume_attachments/2d3880b8-a549-47f4-8423-6b667746ceb2 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:54:46.910767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:46.911781 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:46.918299 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:46.918757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:46.919613 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:46.920071 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:46.954254 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2e1e7f9c-fc24-4397-87d2-342eb7856157 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047564 Feb 07 04:54:46.954833 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 588/1263] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:54:46 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:47.493542 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:47.494121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:47.500016 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:47.500493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:47.501261 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:47.501694 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:47.525772 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:54:47.605249 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-32390a49-d432-400d-8a05-69cb82f5a973 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 204 len: 0 microversion: 2.1 time: 0.115646 Feb 07 04:54:47.605899 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 676/1264] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:54:47 2022] DELETE /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:54:47.615083 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:47.615692 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:47.622611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:47.623062 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:47.623840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:47.624302 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:47.861821 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:47.869050 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f610ca42-8a23-4559-81a2-52c2929f7c0c tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1513 microversion: 2.1 time: 0.258290 Feb 07 04:54:47.869610 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 589/1265] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:47 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:48.886972 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:48.887712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:48.894448 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:48.894906 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:48.895683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:48.896146 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:49.079115 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:49.086854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-fa950a4d-9e1f-476f-baaa-0a12ee18c838 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1513 microversion: 2.1 time: 0.203969 Feb 07 04:54:49.087409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 677/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:48 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:50.103804 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:50.104562 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:50.110652 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:50.111093 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:50.111941 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:50.112583 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:50.249512 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b509b217add444b191e92b67f18614cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef628b18fee54b219122e9accae291b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:54:50.258180 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bc7c8130-83a0-4247-b327-67d42873a348 tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 200 len: 1513 microversion: 2.1 time: 0.157962 Feb 07 04:54:50.263125 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 590/1267] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:50 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:54:50.269343 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-474fb434-83d1-4500-ac87-0905e43deedd req-8d928182-19a6-455f-994d-7fb1c4c4e14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad211db-78a9-43e7-a075-8e1f11829a1c", "name": "network-vif-deleted", "tag": "524fc619-8a6e-44d4-a3b6-6015664a54f8"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:54:50.271041 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:54:50.271041 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:54:50.278673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-474fb434-83d1-4500-ac87-0905e43deedd req-8d928182-19a6-455f-994d-7fb1c4c4e14a service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:50.279121 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-474fb434-83d1-4500-ac87-0905e43deedd req-8d928182-19a6-455f-994d-7fb1c4c4e14a service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:50.291695 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-474fb434-83d1-4500-ac87-0905e43deedd req-8d928182-19a6-455f-994d-7fb1c4c4e14a service nova] Creating event network-vif-deleted:524fc619-8a6e-44d4-a3b6-6015664a54f8 for instance 2ad211db-78a9-43e7-a075-8e1f11829a1c on hv-cinder-79963 Feb 07 04:54:50.296603 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-474fb434-83d1-4500-ac87-0905e43deedd req-8d928182-19a6-455f-994d-7fb1c4c4e14a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Feb 07 04:54:50.297214 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 678/1268] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:54:51.275892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:54:51.276444 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] [instance: 2ad211db-78a9-43e7-a075-8e1f11829a1c] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:54:51.282607 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:51.283056 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:51.284462 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:54:51.284896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:54:51.297606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] HTTP exception thrown: Instance 2ad211db-78a9-43e7-a075-8e1f11829a1c could not be found. Feb 07 04:54:51.298178 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] Returning 404 to user: Instance 2ad211db-78a9-43e7-a075-8e1f11829a1c could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:54:51.298978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5ed28073-4c51-4a58-9066-e1fed9d2b15d tempest-VolumesSnapshotTestJSON-668573482 tempest-VolumesSnapshotTestJSON-668573482-project] 10.222.0.13 "GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c" status: 404 len: 111 microversion: 2.1 time: 0.026890 Feb 07 04:54:51.299491 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 591/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:54:51 2022] GET /compute/v2.1/servers/2ad211db-78a9-43e7-a075-8e1f11829a1c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:55:45.666766 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:45.667368 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:45.673985 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:45.674430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:45.675225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:45.675659 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:45.702546 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-49e430e2-f10a-4851-82b6-05aa129f5b5a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/7a9ba551-4e49-4530-8cfa-e44981b66911" status: 200 len: 194 microversion: 2.1 time: 0.040502 Feb 07 04:55:45.703096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 679/1270] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Feb 7 04:55:45 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/7a9ba551-4e49-4530-8cfa-e44981b66911 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:55:45.712235 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:45.712749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:45.718606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:45.719075 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:45.719840 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:45.720829 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:45.795879 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lazy-loading 'services' on Instance uuid c3200f43-e8d2-4ce0-bb56-05d458252ede {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:55:45.861687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-730e5862-3064-424e-91e6-a1099ff28b7a tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/7a9ba551-4e49-4530-8cfa-e44981b66911" status: 202 len: 0 microversion: 2.1 time: 0.152348 Feb 07 04:55:45.862253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 592/1271] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:55:45 2022] DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/7a9ba551-4e49-4530-8cfa-e44981b66911 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:55:48.024986 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:48.025497 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:48.031609 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:48.032076 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:48.033410 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:48.033849 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:48.061808 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-1a5b6c44-966a-494d-b289-1c82db742467 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/2f9cfe0c-28a5-43d6-befa-384035a19710" status: 200 len: 194 microversion: 2.1 time: 0.040508 Feb 07 04:55:48.062380 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 680/1272] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Feb 7 04:55:48 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/2f9cfe0c-28a5-43d6-befa-384035a19710 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:55:48.073126 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:48.073710 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:48.079867 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:48.080350 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:48.081162 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:48.081607 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:48.156236 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lazy-loading 'services' on Instance uuid c3200f43-e8d2-4ce0-bb56-05d458252ede {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:55:48.222926 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d2e1188c-bc08-4348-85dd-258ecfd439a2 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/2f9cfe0c-28a5-43d6-befa-384035a19710" status: 202 len: 0 microversion: 2.1 time: 0.154361 Feb 07 04:55:48.223576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 593/1273] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Feb 7 04:55:48 2022] DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments/2f9cfe0c-28a5-43d6-befa-384035a19710 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:55:49.378087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:49.379210 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:49.385557 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.386007 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.386782 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.387219 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.415128 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b0db088b-2009-4cc6-98e8-07b9ee0e3cb1 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041830 Feb 07 04:55:49.415670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 681/1274] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:55:49 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:55:49.513267 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:49.514349 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:49.520966 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.521421 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.522202 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.522645 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.550067 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-2169f918-ccc6-452d-ae1c-953df647232e tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041471 Feb 07 04:55:49.550581 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 594/1275] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Feb 7 04:55:49 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 07 04:55:49.603772 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:49.604300 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:49.609971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.610419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.611714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.612808 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.636767 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:55:49.708576 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-4a652c01-204f-4272-b2d0-a4169322a6ad tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 204 len: 0 microversion: 2.1 time: 0.108074 Feb 07 04:55:49.709400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 682/1276] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:55:49 2022] DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:55:49.717651 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:49.718260 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:49.724091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.724549 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.725332 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:49.725768 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:49.859287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:55:49.867091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-333d5c8b-2d28-4206-a333-b51ecc3978b7 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1672 microversion: 2.1 time: 0.153090 Feb 07 04:55:49.867649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 595/1277] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:49 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:55:50.884629 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:50.885337 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:50.891425 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:50.891861 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:50.892676 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:50.893110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:51.026307 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:55:51.034088 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-10bfad86-f2f7-45de-be04-3937e51e5e1c tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1672 microversion: 2.1 time: 0.153528 Feb 07 04:55:51.034649 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 683/1278] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:50 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:55:52.050098 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:52.050711 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:52.056976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:52.057431 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:52.058216 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:52.058653 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:52.190445 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:55:52.197757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e637b572-ca5c-49f0-b6cd-4e390081ba35 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1672 microversion: 2.1 time: 0.151361 Feb 07 04:55:52.198329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 596/1279] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:52 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:55:53.126598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-4a233730-cfd6-4dc9-84d0-fd96687d7647 req-76b5c788-5be3-4684-896d-ddb4ab0d9636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3200f43-e8d2-4ce0-bb56-05d458252ede", "name": "network-vif-deleted", "tag": "251daae1-beca-4649-8675-6b45ef72321b"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:55:53.129017 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:55:53.129017 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:55:53.136909 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-4a233730-cfd6-4dc9-84d0-fd96687d7647 req-76b5c788-5be3-4684-896d-ddb4ab0d9636 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:53.137400 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-4a233730-cfd6-4dc9-84d0-fd96687d7647 req-76b5c788-5be3-4684-896d-ddb4ab0d9636 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:53.148769 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-4a233730-cfd6-4dc9-84d0-fd96687d7647 req-76b5c788-5be3-4684-896d-ddb4ab0d9636 service nova] Creating event network-vif-deleted:251daae1-beca-4649-8675-6b45ef72321b for instance c3200f43-e8d2-4ce0-bb56-05d458252ede on hv-cinder-79963 Feb 07 04:55:53.154236 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-4a233730-cfd6-4dc9-84d0-fd96687d7647 req-76b5c788-5be3-4684-896d-ddb4ab0d9636 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Feb 07 04:55:53.154873 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 684/1280] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:55:53.215048 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:53.215669 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:53.223196 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:53.223811 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:53.225128 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:53.225665 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:53.263517 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:53.263995 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:53.264476 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lazy-loading 'fault' on Instance uuid c3200f43-e8d2-4ce0-bb56-05d458252ede {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:55:53.307415 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfb108826147368ceb199e2e4da59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f954da0f8764195bc7bb449ea7c7412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:55:53.315273 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-86fb8a7d-b390-41eb-8129-6645357a0c02 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 200 len: 1325 microversion: 2.1 time: 0.104232 Feb 07 04:55:53.315844 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 597/1281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:53 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:55:54.333045 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:54.333743 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:54.339727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:54.340205 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:54.340978 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:54.341409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:54.354244 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] HTTP exception thrown: Instance c3200f43-e8d2-4ce0-bb56-05d458252ede could not be found. Feb 07 04:55:54.354756 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Returning 404 to user: Instance c3200f43-e8d2-4ce0-bb56-05d458252ede could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:55:54.355567 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e4cff895-ad91-4376-b52c-83e1ee936e88 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 404 len: 111 microversion: 2.1 time: 0.027054 Feb 07 04:55:54.356294 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 685/1282] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:54 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:55:54.364649 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e61469f9-1b0b-4e31-a408-bc4b73dd1eb6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '.version_select at 0x7f917bd69ca0>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:54.383510 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e61469f9-1b0b-4e31-a408-bc4b73dd1eb6 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66233011" status: 202 len: 0 microversion: 2.1 time: 0.022742 Feb 07 04:55:54.384087 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 598/1283] 10.222.0.13 () {58 vars in 1214 bytes} [Mon Feb 7 04:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66233011 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 07 04:55:57.220398 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:57.220897 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:57.227600 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:57.228075 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:57.228837 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:57.229271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:57.242871 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] HTTP exception thrown: Instance c3200f43-e8d2-4ce0-bb56-05d458252ede could not be found. Feb 07 04:55:57.243461 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Returning 404 to user: Instance c3200f43-e8d2-4ce0-bb56-05d458252ede could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:55:57.244317 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-3e48e207-d9c9-4dae-91be-33f241339c10 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 404 len: 111 microversion: 2.1 time: 0.027743 Feb 07 04:55:57.245039 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 686/1284] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:55:57 2022] DELETE /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:55:57.257631 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:57.258248 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: c3200f43-e8d2-4ce0-bb56-05d458252ede] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:57.264354 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:57.264805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:57.265595 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:57.266031 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:57.279217 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] HTTP exception thrown: Instance c3200f43-e8d2-4ce0-bb56-05d458252ede could not be found. Feb 07 04:55:57.279801 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Returning 404 to user: Instance c3200f43-e8d2-4ce0-bb56-05d458252ede could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:55:57.280655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-da1fe349-2b7e-4b75-956b-df1f5bf2e3ef tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede" status: 404 len: 111 microversion: 2.1 time: 0.026793 Feb 07 04:55:57.281191 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 599/1285] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:57 2022] GET /compute/v2.1/servers/c3200f43-e8d2-4ce0-bb56-05d458252ede => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:55:58.405778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:58.406305 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:58.412479 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:58.412931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:58.413708 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:58.414144 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:58.426836 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] HTTP exception thrown: Instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb could not be found. Feb 07 04:55:58.427419 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Returning 404 to user: Instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:55:58.428258 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-39921183-8662-4094-915a-c53d2d68da04 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 404 len: 111 microversion: 2.1 time: 0.026112 Feb 07 04:55:58.428778 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 687/1286] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:55:58 2022] DELETE /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:55:58.436408 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:55:58.437026 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] [instance: 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:55:58.443671 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:58.444157 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:58.444954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:55:58.445389 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:55:58.459773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] HTTP exception thrown: Instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb could not be found. Feb 07 04:55:58.460390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] Returning 404 to user: Instance 570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:55:58.461202 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c1ec8db4-97af-41af-91ca-e51f7e89db59 tempest-AttachVolumeTestJSON-290520966 tempest-AttachVolumeTestJSON-290520966-project] 10.222.0.13 "GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb" status: 404 len: 111 microversion: 2.1 time: 0.028548 Feb 07 04:55:58.461722 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 600/1287] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:55:58 2022] GET /compute/v2.1/servers/570a34f8-6605-44c1-9a7e-d5cf8d7d0fbb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:56:29.102177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:56:29.102761 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:56:30.192771 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:56:30.193297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:56:38.560853 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:56:38.561651 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:57:44.555509 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:57:44.556169 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:57:44.562003 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:44.562452 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:44.563225 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:44.563681 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:44.577849 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:57:44.578424 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:57:44.579228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-90038e6a-439d-43c7-a177-fe079a24b90b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.028683 Feb 07 04:57:44.579734 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 688/1288] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:57:44 2022] DELETE /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:57:44.588474 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:57:44.589087 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 65197dd0-1ef5-46a4-bd5c-c4214703105b] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:57:44.594854 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:44.595303 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:44.596100 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:44.596548 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:44.610283 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. Feb 07 04:57:44.610864 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 65197dd0-1ef5-46a4-bd5c-c4214703105b could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:57:44.611687 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-695d24d1-d352-4e50-8138-eb4b7a967b0b tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b" status: 404 len: 111 microversion: 2.20 time: 0.027893 Feb 07 04:57:44.612240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 601/1289] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:57:44 2022] GET /compute/v2.1/servers/65197dd0-1ef5-46a4-bd5c-c4214703105b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:57:45.739156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:57:45.739655 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:57:45.745938 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:45.746392 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:45.747171 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:45.747612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:45.761136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 09f8629b-adac-41b3-a311-37fc873a7a29 could not be found. Feb 07 04:57:45.761712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 09f8629b-adac-41b3-a311-37fc873a7a29 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:57:45.762510 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-53ed845f-120a-4fa1-85e7-dbafc36a3870 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "DELETE /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 404 len: 111 microversion: 2.20 time: 0.027096 Feb 07 04:57:45.763022 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 689/1290] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Feb 7 04:57:45 2022] DELETE /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:57:45.771359 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:57:45.771977 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] [instance: 09f8629b-adac-41b3-a311-37fc873a7a29] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:57:45.778294 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:45.778747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:45.779532 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:57:45.779967 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:57:45.792870 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] HTTP exception thrown: Instance 09f8629b-adac-41b3-a311-37fc873a7a29 could not be found. Feb 07 04:57:45.793449 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] Returning 404 to user: Instance 09f8629b-adac-41b3-a311-37fc873a7a29 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:57:45.794258 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-484fd939-9b4b-4632-8286-9ea4647b6847 tempest-AttachVolumeShelveTestJSON-2111945758 tempest-AttachVolumeShelveTestJSON-2111945758-project] 10.222.0.13 "GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29" status: 404 len: 111 microversion: 2.20 time: 0.027268 Feb 07 04:57:45.794774 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 602/1291] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Feb 7 04:57:45 2022] GET /compute/v2.1/servers/09f8629b-adac-41b3-a311-37fc873a7a29 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 07 04:58:25.570973 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:58:25.571606 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 04:58:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:58:39.649846 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 04:58:39.650390 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 04:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 04:58:44.410673 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-283698844", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "25d41e1d-c764-4233-a0dc-c9f2343938ed"}]}} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:58:44.461243 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.network.neutron [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] validate_networks() for [('25d41e1d-c764-4233-a0dc-c9f2343938ed', None, None, None, None, None)] {{(pid=116493) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:58:44.863241 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Flavor limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:58:44.863665 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Image limits 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:58:44.864200 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Flavor pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:58:44.864614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Image pref 0:0:0 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:58:44.865055 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.virt.hardware [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:58:44.873663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:44.874131 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:44.874943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:44.875381 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:44.892690 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Getting quotas for project 0a23dbd278e64a36b3374923e9517836. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:58:44.896586 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.quota [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Getting quotas for user f8407feadda44c258a61e454d6196291 and project 0a23dbd278e64a36b3374923e9517836. Resources: {'ram', 'cores', 'instances'} {{(pid=116493) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:58:44.907943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Going to run 1 instances... {{(pid=116493) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:58:44.910302 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:58:44.956267 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-223625e7-74a9-4385-abfe-8d40f0f7fb35 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549351 Feb 07 04:58:44.957096 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 690/1292] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:58:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:58:44.970103 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-660bc184-7ffb-4be7-b284-a9ed9b8e930e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:44.972122 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-660bc184-7ffb-4be7-b284-a9ed9b8e930e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:45.030817 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-660bc184-7ffb-4be7-b284-a9ed9b8e930e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:45.037339 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-660bc184-7ffb-4be7-b284-a9ed9b8e930e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1213 microversion: 2.1 time: 0.073509 Feb 07 04:58:45.038133 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 603/1293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:44 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:46.053882 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:46.055213 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:46.061590 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:46.062111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:46.063046 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:46.063492 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:46.163524 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:46.171496 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b40b823e-ea75-4d11-adfa-a0c513e53232 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1271 microversion: 2.1 time: 0.121988 Feb 07 04:58:46.172087 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 691/1294] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:46 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:47.188673 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:47.189136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:47.196146 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:47.196594 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:47.197372 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:47.197803 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:47.311336 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-faa405c5-1ce1-4669-a85a-174b1122e4b4 req-cb69188b-c12a-4a38-a66c-534a66e10c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3008bb-f478-409c-abba-fcaedfe015f1", "tag": "c00954be-7b59-47eb-9108-932081541ec1"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:58:47.314654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:58:47.314654 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:58:47.323599 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-faa405c5-1ce1-4669-a85a-174b1122e4b4 req-cb69188b-c12a-4a38-a66c-534a66e10c4c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:47.324412 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-faa405c5-1ce1-4669-a85a-174b1122e4b4 req-cb69188b-c12a-4a38-a66c-534a66e10c4c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:47.336294 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-faa405c5-1ce1-4669-a85a-174b1122e4b4 req-cb69188b-c12a-4a38-a66c-534a66e10c4c service nova] Creating event network-changed:c00954be-7b59-47eb-9108-932081541ec1 for instance 7d3008bb-f478-409c-abba-fcaedfe015f1 on hv-cinder-79963 Feb 07 04:58:47.339525 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:47.343488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-faa405c5-1ce1-4669-a85a-174b1122e4b4 req-cb69188b-c12a-4a38-a66c-534a66e10c4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036334 Feb 07 04:58:47.344409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 692/1295] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:58:47.347542 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-17f84cb1-016f-4278-8c0c-2e0854608796 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.162774 Feb 07 04:58:47.348109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 604/1296] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:47 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:48.365661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:48.366286 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:48.372841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:48.373291 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:48.374069 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:48.374507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:48.511296 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:48.518501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-8dd9f180-a2f0-4be3-b990-e4c60d40ab44 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.157450 Feb 07 04:58:48.519062 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 693/1297] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:48 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:49.535281 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:49.535902 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:49.542279 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:49.542730 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:49.543507 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:49.543944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:49.675698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:49.683611 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b4f0e41b-29b3-4f19-ae72-65c12eb1b22f tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.151978 Feb 07 04:58:49.684203 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 605/1298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:49 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:50.700616 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:50.701253 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:50.707443 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:50.707891 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:50.708699 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:50.709135 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:50.840712 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:50.847905 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b178fb97-2b58-4746-8dcb-58701d988940 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.150905 Feb 07 04:58:50.848494 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 694/1299] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:50 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:51.864575 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:51.865189 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:51.871463 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:51.871913 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:51.872740 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:51.873178 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:52.008511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:52.015723 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-f34f813d-5fd0-4e44-a293-9f74f59b3cda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.154817 Feb 07 04:58:52.016320 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 606/1300] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:51 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:53.032754 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:53.033368 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:53.040211 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:53.041129 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:53.041435 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:53.041877 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:53.174637 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:53.181796 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-f49696af-f087-48a1-9101-6700457ff959 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.152755 Feb 07 04:58:53.182362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 695/1301] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:53 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:53.756553 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-17180ea2-0708-4ba0-a0ca-8932a930d436 req-b6c0a9d5-967c-4346-858f-94b8171b9340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3008bb-f478-409c-abba-fcaedfe015f1", "name": "network-vif-plugged", "status": "completed", "tag": "c00954be-7b59-47eb-9108-932081541ec1"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:58:53.758593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:58:53.758593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:58:53.765845 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-17180ea2-0708-4ba0-a0ca-8932a930d436 req-b6c0a9d5-967c-4346-858f-94b8171b9340 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:53.766287 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-17180ea2-0708-4ba0-a0ca-8932a930d436 req-b6c0a9d5-967c-4346-858f-94b8171b9340 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:53.776944 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-17180ea2-0708-4ba0-a0ca-8932a930d436 req-b6c0a9d5-967c-4346-858f-94b8171b9340 service nova] Creating event network-vif-plugged:c00954be-7b59-47eb-9108-932081541ec1 for instance 7d3008bb-f478-409c-abba-fcaedfe015f1 on hv-cinder-79963 Feb 07 04:58:53.782834 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-17180ea2-0708-4ba0-a0ca-8932a930d436 req-b6c0a9d5-967c-4346-858f-94b8171b9340 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029975 Feb 07 04:58:53.783451 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 607/1302] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:58:54.198201 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:54.198812 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:54.205222 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:54.205614 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:54.206387 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:54.206825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:54.338696 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:54.345854 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-bec34821-3dcd-439f-a1f6-5b2ac064ad19 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.151340 Feb 07 04:58:54.346413 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 696/1303] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:54 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:55.364113 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:55.364735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:55.371278 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:55.371747 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:55.372554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:55.372994 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:55.510605 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:55.518002 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-496131de-5510-4476-8cb0-658062f86bda tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1313 microversion: 2.1 time: 0.158405 Feb 07 04:58:55.518570 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 608/1304] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:55 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:56.534454 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:56.535064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:56.541089 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:56.541546 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:56.542323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:56.542758 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:56.671727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:56.679430 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ebe327ce-209f-436e-ac99-80e470428989 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1496 microversion: 2.1 time: 0.148275 Feb 07 04:58:56.680064 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 697/1305] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:56 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1496 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:57.110490 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:57.110978 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:57.116679 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:57.117132 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:57.117911 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:57.118351 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:57.144450 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Going to try to terminate instance {{(pid=116492) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:58:57.216767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-14ed8380-ec3f-4821-8618-1d2a801c5b5b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 204 len: 0 microversion: 2.1 time: 0.109785 Feb 07 04:58:57.217558 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 609/1306] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:58:57 2022] DELETE /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:58:57.227501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:57.228157 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:57.233944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:57.234433 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:57.235220 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:57.235663 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:57.362841 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:57.370658 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-90eb180f-ee7d-4322-8082-79ca31c18128 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1502 microversion: 2.1 time: 0.148629 Feb 07 04:58:57.371221 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 698/1307] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:57 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:58.389376 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:58.390079 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:58.396501 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:58.396981 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:58.397761 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:58.398196 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:58.531193 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:58.538979 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-d446d47b-44b2-4c8b-a81b-3a2ffd88d857 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1502 microversion: 2.1 time: 0.153177 Feb 07 04:58:58.539554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 610/1308] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:58 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:58:59.555556 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:58:59.556241 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:58:59.557801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-18e31c06-d251-496a-b2ee-d1f7330e6c73 req-d40761c4-bdd6-4236-8e50-0931358eb5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3008bb-f478-409c-abba-fcaedfe015f1", "name": "network-vif-deleted", "tag": "c00954be-7b59-47eb-9108-932081541ec1"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:58:59.559446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:58:59.559446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 04:58:59.562767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:59.563215 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:59.564012 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:59.564588 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:59.566585 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-18e31c06-d251-496a-b2ee-d1f7330e6c73 req-d40761c4-bdd6-4236-8e50-0931358eb5d8 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:59.567120 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-18e31c06-d251-496a-b2ee-d1f7330e6c73 req-d40761c4-bdd6-4236-8e50-0931358eb5d8 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:59.579703 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-18e31c06-d251-496a-b2ee-d1f7330e6c73 req-d40761c4-bdd6-4236-8e50-0931358eb5d8 service nova] Creating event network-vif-deleted:c00954be-7b59-47eb-9108-932081541ec1 for instance 7d3008bb-f478-409c-abba-fcaedfe015f1 on hv-cinder-79963 Feb 07 04:58:59.584702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-18e31c06-d251-496a-b2ee-d1f7330e6c73 req-d40761c4-bdd6-4236-8e50-0931358eb5d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150482 Feb 07 04:58:59.585342 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 699/1309] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:58:59.598301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:58:59.598759 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:58:59.599218 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.objects.instance [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lazy-loading 'fault' on Instance uuid 7d3008bb-f478-409c-abba-fcaedfe015f1 {{(pid=116492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:58:59.638963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:58:59.646286 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-065f8886-fc98-455c-90b4-4938a3ae7d25 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 200 len: 1303 microversion: 2.1 time: 0.094982 Feb 07 04:58:59.646906 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 611/1310] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:58:59 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 04:59:00.663825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:00.664549 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 7d3008bb-f478-409c-abba-fcaedfe015f1] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:00.670604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:00.671053 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:00.672111 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:00.672348 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:00.685774 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.wsgi [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] HTTP exception thrown: Instance 7d3008bb-f478-409c-abba-fcaedfe015f1 could not be found. Feb 07 04:59:00.686488 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Returning 404 to user: Instance 7d3008bb-f478-409c-abba-fcaedfe015f1 could not be found. {{(pid=116493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:59:00.687316 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-312b5a2e-db0e-44e1-9660-d43f1862ab9d tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1" status: 404 len: 111 microversion: 2.1 time: 0.028486 Feb 07 04:59:00.687851 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 700/1311] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:00 2022] GET /compute/v2.1/servers/7d3008bb-f478-409c-abba-fcaedfe015f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:59:00.734744 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1896875128", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452", "networks": [{"uuid": "25d41e1d-c764-4233-a0dc-c9f2343938ed"}]}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:59:00.784739 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] validate_networks() for [('25d41e1d-c764-4233-a0dc-c9f2343938ed', None, None, None, None, None)] {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 04:59:01.154107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 04:59:01.154536 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 04:59:01.155070 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 04:59:01.155482 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 04:59:01.155894 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 04:59:01.166185 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:01.166632 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:01.167440 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:01.167871 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:01.183530 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Getting quotas for project 0a23dbd278e64a36b3374923e9517836. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 04:59:01.187384 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Getting quotas for user f8407feadda44c258a61e454d6196291 and project 0a23dbd278e64a36b3374923e9517836. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 04:59:01.197720 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 04:59:01.199971 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 04:59:01.244892 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-b6f6950c-4063-4631-b123-cd91db12e059 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513516 Feb 07 04:59:01.245540 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 612/1312] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 04:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 04:59:01.255370 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ba10442a-72e1-4f87-9174-02792a67fa54 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:01.256284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ba10442a-72e1-4f87-9174-02792a67fa54 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:01.307727 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ba10442a-72e1-4f87-9174-02792a67fa54 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:01.314136 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ba10442a-72e1-4f87-9174-02792a67fa54 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1214 microversion: 2.1 time: 0.062444 Feb 07 04:59:01.314693 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 701/1313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:01 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:02.330584 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-1eaa53e3-55e0-4701-8dd7-45cf7081c8b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:02.331201 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-1eaa53e3-55e0-4701-8dd7-45cf7081c8b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:02.388259 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-1eaa53e3-55e0-4701-8dd7-45cf7081c8b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:02.391478 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-1eaa53e3-55e0-4701-8dd7-45cf7081c8b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1214 microversion: 2.1 time: 0.064495 Feb 07 04:59:02.392153 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 613/1314] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:02 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:03.408207 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-943b5ce1-7e43-4810-b6dc-5d8bff8de100 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:03.408825 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-943b5ce1-7e43-4810-b6dc-5d8bff8de100 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:03.461745 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-943b5ce1-7e43-4810-b6dc-5d8bff8de100 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:03.469001 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-943b5ce1-7e43-4810-b6dc-5d8bff8de100 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1214 microversion: 2.1 time: 0.064387 Feb 07 04:59:03.469552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 702/1315] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:03 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:04.484779 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:04.485380 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:04.491620 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:04.492091 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:04.492869 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:04.493297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:04.550966 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:04.558420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-75e82570-af81-4ceb-b06a-bb02b0c50ea9 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1218 microversion: 2.1 time: 0.077404 Feb 07 04:59:04.558991 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 614/1316] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:04 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:05.574561 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:05.575187 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:05.581384 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:05.581831 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:05.582605 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:05.583038 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:05.651944 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:05.660483 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d355eb0e-9d81-4806-8f46-e5184890c1e4 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1272 microversion: 2.1 time: 0.089453 Feb 07 04:59:05.661056 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 703/1317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:05 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:06.590125 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-2fdfaae2-665f-415a-8a87-642706f5fb12 req-160b47c4-fabb-48b6-9eef-7747abdddd4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1277d176-0ac2-4740-bda5-d66f449a48f5", "tag": "765b6c56-6774-4d23-826d-ae29847bd022"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:59:06.591773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:59:06.591773 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:59:06.599927 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-2fdfaae2-665f-415a-8a87-642706f5fb12 req-160b47c4-fabb-48b6-9eef-7747abdddd4d service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:06.600760 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-2fdfaae2-665f-415a-8a87-642706f5fb12 req-160b47c4-fabb-48b6-9eef-7747abdddd4d service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:06.612405 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-2fdfaae2-665f-415a-8a87-642706f5fb12 req-160b47c4-fabb-48b6-9eef-7747abdddd4d service nova] Creating event network-changed:765b6c56-6774-4d23-826d-ae29847bd022 for instance 1277d176-0ac2-4740-bda5-d66f449a48f5 on hv-cinder-79963 Feb 07 04:59:06.617933 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-2fdfaae2-665f-415a-8a87-642706f5fb12 req-160b47c4-fabb-48b6-9eef-7747abdddd4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031055 Feb 07 04:59:06.618522 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 615/1318] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:59:06.678100 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:06.678817 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:06.685948 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:06.686397 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:06.687188 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:06.687628 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:06.930451 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:06.937994 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-430ac42f-e8fe-44ec-938c-760d95aa89d8 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1314 microversion: 2.1 time: 0.263881 Feb 07 04:59:06.938875 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 704/1319] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:06 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:07.956182 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:07.956884 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:07.963770 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:07.964240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:07.965013 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:07.965444 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:08.105757 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:08.112997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-48344dd2-7973-4ad7-a4ef-ddaf13983c3b tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1314 microversion: 2.1 time: 0.161702 Feb 07 04:59:08.113563 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 616/1320] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:07 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:09.129441 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:09.130053 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:09.136477 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:09.136931 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:09.137702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:09.138143 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:09.269901 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:09.277577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-aedfef14-d20b-4188-9331-f3f362f888ff tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1314 microversion: 2.1 time: 0.151956 Feb 07 04:59:09.278137 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 705/1321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:09 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:10.294043 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:10.294646 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:10.301041 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:10.301488 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:10.302263 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:10.302698 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:10.433945 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:10.441398 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-6f88e22a-2b56-4a08-abf3-80f0a863692e tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1314 microversion: 2.1 time: 0.150997 Feb 07 04:59:10.441968 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 617/1322] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:10 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:11.457552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:11.458159 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:11.464964 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:11.465409 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:11.466175 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:11.466604 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:11.597554 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:11.604704 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-db279deb-3bbb-4009-a59b-31a0bf0675d5 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1314 microversion: 2.1 time: 0.150774 Feb 07 04:59:11.605271 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 706/1323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:11 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:11.861305 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-74e68557-ca44-4f36-85e2-1c6c7c9aed72 req-c73965f3-a779-4638-adae-f9cf37ce8b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277d176-0ac2-4740-bda5-d66f449a48f5", "name": "network-vif-plugged", "status": "completed", "tag": "765b6c56-6774-4d23-826d-ae29847bd022"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:59:11.862808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:59:11.862808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:59:11.871588 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-74e68557-ca44-4f36-85e2-1c6c7c9aed72 req-c73965f3-a779-4638-adae-f9cf37ce8b07 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:11.871798 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-74e68557-ca44-4f36-85e2-1c6c7c9aed72 req-c73965f3-a779-4638-adae-f9cf37ce8b07 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:11.882946 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-74e68557-ca44-4f36-85e2-1c6c7c9aed72 req-c73965f3-a779-4638-adae-f9cf37ce8b07 service nova] Creating event network-vif-plugged:765b6c56-6774-4d23-826d-ae29847bd022 for instance 1277d176-0ac2-4740-bda5-d66f449a48f5 on hv-cinder-79963 Feb 07 04:59:11.887805 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-74e68557-ca44-4f36-85e2-1c6c7c9aed72 req-c73965f3-a779-4638-adae-f9cf37ce8b07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030223 Feb 07 04:59:11.888453 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 618/1324] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:59:12.621322 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:12.621939 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:12.628446 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:12.628898 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:12.629680 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:12.630112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:12.757911 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:12.765037 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-c97a5b3f-3356-4230-8f6e-2afde12158ab tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1314 microversion: 2.1 time: 0.147971 Feb 07 04:59:12.765595 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 707/1325] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:12 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:13.781562 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:13.782253 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:13.788323 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:13.788767 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:13.789531 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:13.789963 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:13.921678 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:13.929021 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-93f1d6fe-9aab-4053-bea8-44facb06dc94 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1497 microversion: 2.1 time: 0.151941 Feb 07 04:59:13.930086 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 619/1326] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:13 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:14.390790 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:14.391284 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:14.397466 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:14.397920 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:14.398702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:14.399144 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:14.423577 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 04:59:14.494768 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d5aa6259-6d82-4e24-9425-df656b9e38b7 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 204 len: 0 microversion: 2.1 time: 0.107361 Feb 07 04:59:14.495358 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 708/1327] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 04:59:14 2022] DELETE /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 04:59:14.504411 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:14.505024 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:14.510827 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:14.511280 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:14.512072 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:14.512516 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:14.641038 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:14.648808 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-fed42429-bf48-4f54-aa79-b4f554b229c2 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1503 microversion: 2.1 time: 0.148213 Feb 07 04:59:14.649375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 620/1328] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:14 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:15.667059 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:15.667791 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:15.673952 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:15.674396 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:15.675168 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:15.675598 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:15.805786 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:15.812957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b0670fb9-c75c-4653-b4cb-7b333d91e9ec tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1503 microversion: 2.1 time: 0.150418 Feb 07 04:59:15.813520 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 709/1329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:15 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:16.567420 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-d8e5f4e5-3577-4569-83a5-58841815a07c req-20d8ecdc-8c95-48e1-8e32-742b2a6c0c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277d176-0ac2-4740-bda5-d66f449a48f5", "name": "network-vif-deleted", "tag": "765b6c56-6774-4d23-826d-ae29847bd022"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 04:59:16.568943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 04:59:16.568943 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 04:59:16.576907 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-d8e5f4e5-3577-4569-83a5-58841815a07c req-20d8ecdc-8c95-48e1-8e32-742b2a6c0c55 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:16.577355 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-d8e5f4e5-3577-4569-83a5-58841815a07c req-20d8ecdc-8c95-48e1-8e32-742b2a6c0c55 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:16.589609 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-d8e5f4e5-3577-4569-83a5-58841815a07c req-20d8ecdc-8c95-48e1-8e32-742b2a6c0c55 service nova] Creating event network-vif-deleted:765b6c56-6774-4d23-826d-ae29847bd022 for instance 1277d176-0ac2-4740-bda5-d66f449a48f5 on hv-cinder-79963 Feb 07 04:59:16.596020 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-d8e5f4e5-3577-4569-83a5-58841815a07c req-20d8ecdc-8c95-48e1-8e32-742b2a6c0c55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Feb 07 04:59:16.596647 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 621/1330] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 04:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 04:59:16.829714 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:16.830353 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:16.837004 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:16.837455 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:16.838228 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:16.838661 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:16.868489 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:16.868936 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:16.869379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lazy-loading 'fault' on Instance uuid 1277d176-0ac2-4740-bda5-d66f449a48f5 {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 04:59:16.909079 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8407feadda44c258a61e454d6196291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a23dbd278e64a36b3374923e9517836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 04:59:16.916957 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-28c8ff45-8fb4-4680-aca0-b69f3a2e9988 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 200 len: 1304 microversion: 2.1 time: 0.091015 Feb 07 04:59:16.917507 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 710/1331] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:16 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 04:59:17.934749 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:17.935483 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] [instance: 1277d176-0ac2-4740-bda5-d66f449a48f5] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 04:59:17.941946 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:17.942397 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:17.943176 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 04:59:17.943614 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 04:59:17.957138 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] HTTP exception thrown: Instance 1277d176-0ac2-4740-bda5-d66f449a48f5 could not be found. Feb 07 04:59:17.957728 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] Returning 404 to user: Instance 1277d176-0ac2-4740-bda5-d66f449a48f5 could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 04:59:17.958543 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-5e667012-5f1a-46f6-bde2-c7d61b6d7256 tempest-VolumesActionsTest-733202034 tempest-VolumesActionsTest-733202034-project] 10.222.0.13 "GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5" status: 404 len: 111 microversion: 2.1 time: 0.027867 Feb 07 04:59:17.959078 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 622/1332] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 04:59:17 2022] GET /compute/v2.1/servers/1277d176-0ac2-4740-bda5-d66f449a48f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 04:59:50.179919 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-9932fc97-5791-438a-98cb-4c373d38c3af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] Calling method '.version_select at 0x7f9184030c10>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 04:59:50.183234 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9932fc97-5791-438a-98cb-4c373d38c3af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [87e53e26-5e6c-4aab-ab79-96a31597aa9e] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 07 04:59:51.190670 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [None req-9932fc97-5791-438a-98cb-4c373d38c3af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] [87e53e26-5e6c-4aab-ab79-96a31597aa9e] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58194. Feb 07 04:59:51.209839 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-9932fc97-5791-438a-98cb-4c373d38c3af tempest-TestVolumeBootPattern-487210490 tempest-TestVolumeBootPattern-487210490-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1983533653" status: 202 len: 0 microversion: 2.1 time: 1.033474 Feb 07 04:59:51.210436 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 711/1333] 10.222.0.13 () {58 vars in 1262 bytes} [Mon Feb 7 04:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1983533653 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 07 05:00:59.045329 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bda2006b-13e2-4756-bfe8-ca7898679951] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 07 05:00:59.049211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1616779202", "imageRef": "7b541b9e-4576-4dfa-ab50-d3bc75357d76", "flavorRef": "452"}} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 05:00:59.248370 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.network.neutron [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] validate_networks() for None {{(pid=116492) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 07 05:00:59.510039 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Flavor limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 07 05:00:59.510460 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Image limits 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 07 05:00:59.510930 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Flavor pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 07 05:00:59.511338 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Image pref 0:0:0 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 07 05:00:59.511746 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.virt.hardware [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 07 05:00:59.520297 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:00:59.520743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:00:59.521545 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:00:59.521977 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:00:59.538040 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Getting quotas for project 5243d274408f4af9b081191733944eb1. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 07 05:00:59.541841 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.quota [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Getting quotas for user ce1754eb4048488ab0019c8340019dfd and project 5243d274408f4af9b081191733944eb1. Resources: {'ram', 'cores', 'instances'} {{(pid=116492) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 07 05:00:59.552735 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Going to run 1 instances... {{(pid=116492) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 07 05:00:59.554997 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b541b9e-4576-4dfa-ab50-d3bc75357d76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 07 05:00:59.598202 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-a30361cb-21ff-4eaa-8078-07d2d8e598ba tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554924 Feb 07 05:00:59.599196 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 623/1334] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Feb 7 05:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 07 05:00:59.610323 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-0247597a-ce34-498a-b962-9b6c52e47c55 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:00:59.610968 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-0247597a-ce34-498a-b962-9b6c52e47c55 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:00:59.764362 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-0247597a-ce34-498a-b962-9b6c52e47c55 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:00:59.772182 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-0247597a-ce34-498a-b962-9b6c52e47c55 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1215 microversion: 2.1 time: 0.167333 Feb 07 05:00:59.772963 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 712/1335] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:00:59 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:00.791792 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:00.792554 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:00.800868 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:00.801317 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:00.802098 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:00.802529 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:00.807511 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] [bda2006b-13e2-4756-bfe8-ca7898679951] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 58612. Feb 07 05:01:00.863112 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:00.870433 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-e2b07d30-5db6-4205-9acf-f5e0a56c66ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1273 microversion: 2.1 time: 0.084168 Feb 07 05:01:00.870989 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 624/1336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:00 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:01.887976 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:01.891717 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:01.898145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:01.898724 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:01.899641 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:01.900176 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:02.058119 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-893dee38-135a-4c0c-940b-0976f9e60d13 req-f436ffbf-f94a-478d-b14c-e087a67f337f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4148aaf3-c2e1-4883-b363-9517bdd16d2f", "tag": "a45ea4da-5204-4b30-8c37-fee63a3126ae"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 05:01:02.062496 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 05:01:02.062496 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 05:01:02.070823 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-893dee38-135a-4c0c-940b-0976f9e60d13 req-f436ffbf-f94a-478d-b14c-e087a67f337f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:02.071361 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-893dee38-135a-4c0c-940b-0976f9e60d13 req-f436ffbf-f94a-478d-b14c-e087a67f337f service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:02.084274 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-893dee38-135a-4c0c-940b-0976f9e60d13 req-f436ffbf-f94a-478d-b14c-e087a67f337f service nova] Creating event network-changed:a45ea4da-5204-4b30-8c37-fee63a3126ae for instance 4148aaf3-c2e1-4883-b363-9517bdd16d2f on hv-cinder-79963 Feb 07 05:01:02.089408 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-893dee38-135a-4c0c-940b-0976f9e60d13 req-f436ffbf-f94a-478d-b14c-e087a67f337f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036827 Feb 07 05:01:02.090301 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 625/1337] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 05:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 05:01:02.152178 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:02.160148 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-2048f082-9d71-4e55-998e-a8f55c81f5ca tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.275743 Feb 07 05:01:02.160979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 713/1338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:01 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 07 05:01:03.178383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:03.179076 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:03.185142 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:03.185596 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:03.186375 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:03.186876 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:03.321800 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:03.328976 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-c88a54da-34fa-4586-b79e-f98776002d70 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.155071 Feb 07 05:01:03.329551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 626/1339] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:03 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:04.346330 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:04.346886 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:04.354339 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:04.354770 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:04.355552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:04.355990 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:04.493728 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:04.501710 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-b73cad43-fbde-4102-b9c3-bd240b16cb0c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.159811 Feb 07 05:01:04.502272 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 714/1340] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:04 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:05.518606 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:05.519213 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:05.525494 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:05.525954 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:05.526738 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:05.527178 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:05.658964 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:05.666144 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-65dbad1f-5d1b-4d13-a9c4-ad9c2354af87 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.151493 Feb 07 05:01:05.666713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 627/1341] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:05 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:06.686529 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:06.687280 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:06.694229 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:06.694672 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:06.696156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:06.696156 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:06.825357 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:06.833127 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-344f243a-3a25-42f4-8232-8a457d716d0f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.153531 Feb 07 05:01:06.833683 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 715/1342] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:06 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:07.850065 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:07.850713 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:07.856918 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:07.857365 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:07.858136 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:07.859198 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:07.986748 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:07.995222 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-dbd91834-a6b4-4c75-bc9b-ec4833a46162 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.149023 Feb 07 05:01:07.995793 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 628/1343] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:07 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:08.598303 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [req-5918ec44-f3ea-4966-97e5-22154de57d21 req-8c86c554-855c-4419-af1d-b6d03ea3a07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4148aaf3-c2e1-4883-b363-9517bdd16d2f", "name": "network-vif-plugged", "status": "completed", "tag": "a45ea4da-5204-4b30-8c37-fee63a3126ae"}]} {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 05:01:08.600601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 05:01:08.600601 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: warnings.warn(msg) Feb 07 05:01:08.607501 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-5918ec44-f3ea-4966-97e5-22154de57d21 req-8c86c554-855c-4419-af1d-b6d03ea3a07c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:08.607943 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [req-5918ec44-f3ea-4966-97e5-22154de57d21 req-8c86c554-855c-4419-af1d-b6d03ea3a07c service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:08.619086 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.compute.server_external_events [req-5918ec44-f3ea-4966-97e5-22154de57d21 req-8c86c554-855c-4419-af1d-b6d03ea3a07c service nova] Creating event network-vif-plugged:a45ea4da-5204-4b30-8c37-fee63a3126ae for instance 4148aaf3-c2e1-4883-b363-9517bdd16d2f on hv-cinder-79963 Feb 07 05:01:08.624801 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [req-5918ec44-f3ea-4966-97e5-22154de57d21 req-8c86c554-855c-4419-af1d-b6d03ea3a07c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087581 Feb 07 05:01:08.625375 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 716/1344] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 05:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 05:01:09.012109 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:09.012772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:09.018988 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:09.019439 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:09.020240 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:09.020677 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:09.147715 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:09.154947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-42a20c98-e9c3-40eb-9c49-ba8f2085ee89 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.146533 Feb 07 05:01:09.156027 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 629/1345] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:09 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:10.172852 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:10.173552 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:10.179517 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:10.179971 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:10.180781 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:10.181224 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:10.314705 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:10.324405 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-e2ab795a-7ffb-497a-a510-752b5bb3c42c tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1315 microversion: 2.1 time: 0.156137 Feb 07 05:01:10.325427 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 717/1346] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:10 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:11.344486 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:11.345016 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:11.351211 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:11.351655 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:11.352462 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:11.352896 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:11.482437 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:11.489576 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-bb06f8e2-8223-4f6b-9732-a7f015e546ab tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1465 microversion: 2.1 time: 0.148913 Feb 07 05:01:11.490135 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 630/1347] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:11 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1465 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:11.526110 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:11.526612 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:11.532745 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:11.533198 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:11.533976 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:11.534414 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:11.557755 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Going to try to terminate instance {{(pid=116493) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 07 05:01:11.628166 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-d9514587-c820-442e-8c7d-6a1919243f16 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 204 len: 0 microversion: 2.1 time: 0.105302 Feb 07 05:01:11.628746 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 718/1348] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Feb 7 05:01:11 2022] DELETE /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 07 05:01:11.636959 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:11.637593 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:11.643503 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:11.643947 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:11.644772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:11.645254 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:11.778066 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.policy [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116492) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:11.785247 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-ec822aa0-9dd2-4231-b0b5-6449c62e7a17 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1471 microversion: 2.1 time: 0.152249 Feb 07 05:01:11.785807 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 631/1349] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:11 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:12.803000 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:12.803702 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:12.809979 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:12.810434 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:12.811209 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:12.812177 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:12.944579 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:12.951856 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-7f3abe41-a93b-4bb0-a8b8-9ca38853e96f tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1471 microversion: 2.1 time: 0.152944 Feb 07 05:01:12.953051 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 719/1350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:12 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:13.769308 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [req-f16ddf8c-a84c-4654-ab58-dd0e7de2e6b3 req-b1a7671d-3f26-470a-bcc9-ee53e1c8a992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4148aaf3-c2e1-4883-b363-9517bdd16d2f", "name": "network-vif-deleted", "tag": "a45ea4da-5204-4b30-8c37-fee63a3126ae"}]} {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 07 05:01:13.771204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 05:01:13.771204 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: warnings.warn(msg) Feb 07 05:01:13.779848 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-f16ddf8c-a84c-4654-ab58-dd0e7de2e6b3 req-b1a7671d-3f26-470a-bcc9-ee53e1c8a992 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:13.780383 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [req-f16ddf8c-a84c-4654-ab58-dd0e7de2e6b3 req-b1a7671d-3f26-470a-bcc9-ee53e1c8a992 service nova] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:13.793194 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.compute.server_external_events [req-f16ddf8c-a84c-4654-ab58-dd0e7de2e6b3 req-b1a7671d-3f26-470a-bcc9-ee53e1c8a992 service nova] Creating event network-vif-deleted:a45ea4da-5204-4b30-8c37-fee63a3126ae for instance 4148aaf3-c2e1-4883-b363-9517bdd16d2f on hv-cinder-79963 Feb 07 05:01:13.799357 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [req-f16ddf8c-a84c-4654-ab58-dd0e7de2e6b3 req-b1a7671d-3f26-470a-bcc9-ee53e1c8a992 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Feb 07 05:01:13.800290 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 632/1351] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Feb 7 05:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 07 05:01:13.969610 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.api.openstack.wsgi [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:13.970193 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.compute.api [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116493) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:13.976539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:13.976941 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:13.977720 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:13.978153 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:14.010643 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:14.011094 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG oslo_concurrency.lockutils [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:14.011539 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.objects.instance [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lazy-loading 'fault' on Instance uuid 4148aaf3-c2e1-4883-b363-9517bdd16d2f {{(pid=116493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 07 05:01:14.050966 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: DEBUG nova.policy [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1754eb4048488ab0019c8340019dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243d274408f4af9b081191733944eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116493) authorize /opt/stack/nova/nova/policy.py:199}} Feb 07 05:01:14.060071 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO nova.api.openstack.requestlog [None req-ba0847fa-370a-452a-a68d-fbbdd2cf0ba8 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 200 len: 1305 microversion: 2.1 time: 0.094300 Feb 07 05:01:14.060646 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: [pid: 116493|app: 0|req: 720/1352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:13 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 07 05:01:14.780847 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:01:14.781456 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 05:01:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:01:15.077915 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Calling method '>' {{(pid=116492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 07 05:01:15.078551 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.compute.api [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] [instance: 4148aaf3-c2e1-4883-b363-9517bdd16d2f] Fetching instance by UUID {{(pid=116492) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 07 05:01:15.085035 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:15.085483 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:15.086251 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 07 05:01:15.086681 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG oslo_concurrency.lockutils [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Lock "02bf556a-fe9c-41c3-88b0-1429f117219c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 07 05:01:15.099772 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.wsgi [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] HTTP exception thrown: Instance 4148aaf3-c2e1-4883-b363-9517bdd16d2f could not be found. Feb 07 05:01:15.100382 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: DEBUG nova.api.openstack.wsgi [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] Returning 404 to user: Instance 4148aaf3-c2e1-4883-b363-9517bdd16d2f could not be found. {{(pid=116492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 07 05:01:15.101201 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO nova.api.openstack.requestlog [None req-cb733906-5b54-493e-b89a-d02da6b66ce5 tempest-VolumesNegativeTest-1053131430 tempest-VolumesNegativeTest-1053131430-project] 10.222.0.13 "GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f" status: 404 len: 111 microversion: 2.1 time: 0.028034 Feb 07 05:01:15.101743 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: [pid: 116492|app: 0|req: 633/1353] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Feb 7 05:01:15 2022] GET /compute/v2.1/servers/4148aaf3-c2e1-4883-b363-9517bdd16d2f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 07 05:01:29.113493 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:01:29.114024 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 05:01:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:03:25.580379 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:03:25.581122 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 05:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:03:39.659107 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:03:39.659728 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 05:03:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:04:34.789001 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:04:34.789754 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 05:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:04:49.121573 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:04:49.122124 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 05:04:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:04:58.574477 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:04:58.575112 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 05:04:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:06:30.208238 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:06:30.208831 dv-cinder-799631-7-iscsi devstack@n-api.service[116492]: Mon Feb 7 05:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 07 05:06:45.588406 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 07 05:06:45.589145 dv-cinder-799631-7-iscsi devstack@n-api.service[116493]: Mon Feb 7 05:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!